How to train simple AIs

  Рет қаралды 51,341

Pezzza's Work

Pezzza's Work

Күн бұрын

This video is about a simple algorithm to experiment with basic AIs.
Thanks to Alexislouis for the music! @alexislouis2320
You can find the music here: / 18zvih9nrh8gtkjy9
Github github.com/johnBuffer/Pendulu...

Пікірлер: 254
@alexislouis2320
@alexislouis2320 Ай бұрын
Nice video my friend. I would stay around for the seconds parts guys, exciting things ahead ;)
23 күн бұрын
fr
@mox189
@mox189 14 күн бұрын
BASED
@GuildOfCalamity
@GuildOfCalamity Ай бұрын
I could be insane, but I would swear that a rooster just taught me AI.
@bradley1995
@bradley1995 Ай бұрын
He did, and a cock a doodle too!
@CraftingCat_IX
@CraftingCat_IX Ай бұрын
The talking chicken is *slightly* cursed. It’s probably because only the beak is moving and it’s opening a bit too wide for my taste.
@plaintext7288
@plaintext7288 Ай бұрын
+ the balls like red things
@the-bgrspot6997
@the-bgrspot6997 Ай бұрын
hyper cursed tbh
@poultrypants
@poultrypants Ай бұрын
and the balls 🤣🤣
@sumitbiswas164
@sumitbiswas164 29 күн бұрын
Extremely distracting! I would prefer relevant scenes in a serious video.
@volbla
@volbla 28 күн бұрын
I like the chicken. I find it charming :>
@alliepiper4772
@alliepiper4772 Ай бұрын
I'm finally starting to recover from like 3 years of intense burnout as a software engineer, and watching your videos helps me remember why I got into this field in the first place. Looking forward to the next one!
@grahamsnyder762
@grahamsnyder762 Ай бұрын
Since the controller can output an arbitrary cart speed every timestep, it is permitted more or less infinite acceleration. It would be interesting to see how they perform if the available acceleration, (or power, or whatever) is constrained to realistic bounds
Ай бұрын
That's actually pretty standard to alter into a categorical/discrete step.
@knitnatsnokprogramming
@knitnatsnokprogramming Ай бұрын
He’s alive!
@user-lm4nk1zk9y
@user-lm4nk1zk9y Ай бұрын
Now build entire ecosystem with Darwin's evolution principles.
@Maus_Indahaus
@Maus_Indahaus Ай бұрын
I'd like to see that!
@SystemBD
@SystemBD Ай бұрын
That is actually a branch of classical AI called Evolutionary/Genetic Algorithms. They are not hard to code, but they have limited applications.
@Me-0063
@Me-0063 Ай бұрын
@@SystemBDNot hard to code is an understatement. In my opinion, its probably the easiest to code from scratch…
@allanburns1190
@allanburns1190 Ай бұрын
I am actually working on something similar
@TVDaJa
@TVDaJa Ай бұрын
@@Me-0063 They sound to me like a normal neural network that uses random noise and a kind of selection instead of a more guided training algorithm
@Oring17
@Oring17 Ай бұрын
Love your work Pezzza. You are a great inspiration.
@thebetterbutter709
@thebetterbutter709 Ай бұрын
From a frenchmen to another, your accent has improved so much! Your videos are captivating as always.
@proyoloks1386
@proyoloks1386 Ай бұрын
yeah it's insane, I almost forgot that this is the same guy as 8 months ago...
@xernas7880
@xernas7880 Ай бұрын
Finally ! I just love your content, i'm happy to see you again, also on my favorite topic
@mr.ditkovich9983
@mr.ditkovich9983 Ай бұрын
Can't wait to see your next video 🙌🏾🙌🏾
@TheTechnopider
@TheTechnopider Ай бұрын
Extremely excited for the next video! For some reason, AI training videos just scratch a certain itch so nicely
@notthetruedm
@notthetruedm Ай бұрын
I love how you animated this! It looks so cool and made it easy to follow along
@dedelblute3946
@dedelblute3946 Ай бұрын
I love this channel. It's enjoyable to just watch cool coding stuff.
@Hailfire08
@Hailfire08 Ай бұрын
Love your videos and can't wait for the next one!
@knitnatsnokprogramming
@knitnatsnokprogramming Ай бұрын
I’ll binge-watch this rn
@ruolbu
@ruolbu Ай бұрын
how do you binge a single 13 minute video?
@knitnatsnokprogramming
@knitnatsnokprogramming Ай бұрын
@@ruolbu By rewatching it over and over again at 0.25x speed
@PezzzasWork
@PezzzasWork Ай бұрын
Amazing
@ruolbu
@ruolbu 20 күн бұрын
dedication
@issamoudriss6564
@issamoudriss6564 Ай бұрын
This video is super nice man, waitin for the second part!
@NickCombs
@NickCombs Ай бұрын
The first steps are always the hardest, so it might be good to show some actual code examples for them.
@karlosfy
@karlosfy Ай бұрын
Really inspiring. Will be waiting to see the code! Great content :)
@elex6934
@elex6934 Ай бұрын
I love your videos ❤ ai is such an interesting topic and I'll watch part2 as soon as possible
@rigbyb
@rigbyb Ай бұрын
Great video! Glad to see you again
@PloverTechOfficial
@PloverTechOfficial Ай бұрын
This is amazing! I can actually understand how to create my own system if I wanted. Unlike some videos which don’t succeed at telling us in an understandable way.
@srb9767
@srb9767 Ай бұрын
Your projects are amazing, and often very beautiful. I aspire to make software as good as this one day!
@Ibloop
@Ibloop Ай бұрын
I was literally about to work on a project of mine that requires AI, immaculate timing pezzza
@namdao2672
@namdao2672 Ай бұрын
im trying to learn ML and DL by myself and find this super helpful, waiting for your next masterpiece
@Sakejo
@Sakejo Ай бұрын
In the next videos I suggest including some articles, in the description, to delve deeper into the topics discussed. As I was searching for the sources for this project, I couldn't find them.
@JayBenOh
@JayBenOh Ай бұрын
Great video! It's a very nice visual representation ... that must have been a ton of work!
@khatharrmalkavian3306
@khatharrmalkavian3306 Ай бұрын
Double pendulum should be fun. I wonder how good a solution it will be able to find. As an aside, can't you just use the raw pendulum height (summed per frame) as a fitness function?
@simon_aviation
@simon_aviation Ай бұрын
Thank you SOOOO MUCH!!!! I always wanted to do something like this, this will really help!!!
@Wolforce
@Wolforce Ай бұрын
Great video! as always!
@brickstopforall
@brickstopforall Ай бұрын
I was wanting a video on machine learning!! It's from you aswell!
@ZeroPlus707
@ZeroPlus707 Ай бұрын
Great video! Hyped for the double pendulum :)
@gedaliakoehler6992
@gedaliakoehler6992 Ай бұрын
Very neat (haha)! Also great classical controls problem!
@midasscheffers7610
@midasscheffers7610 Ай бұрын
Awsom video, cant wait for the second part
@wjrasmussen666
@wjrasmussen666 24 күн бұрын
That is fun! Good work
@allanburns1190
@allanburns1190 Ай бұрын
This will actually help me so much in my new project
@codedeus
@codedeus Ай бұрын
Great video as usual :D
@motbus3
@motbus3 Ай бұрын
Loved the UIs
@loicsen8003
@loicsen8003 15 күн бұрын
Very nice video, thanks for that
@sofia.eris.bauhaus
@sofia.eris.bauhaus 27 күн бұрын
inverted double pendulum sounds intense! looking forward to it. :)
@CraftingCat_IX
@CraftingCat_IX Ай бұрын
The guy is back :D
@ScienceGuides
@ScienceGuides Ай бұрын
Great work! :-)
@abdulrahmanelawady4501
@abdulrahmanelawady4501 Ай бұрын
Thank you for a great video
@Blooper1980
@Blooper1980 Ай бұрын
Very neat video
@marcelob.5300
@marcelob.5300 Ай бұрын
Wonderful!
@MysteryPancake
@MysteryPancake Ай бұрын
nice! it reminds me of the MarI/O video, it uses this algorithm too
@yraharchenko6364
@yraharchenko6364 Ай бұрын
soooo, now I want to watch the next video, it is so excited
@noahwinslow3252
@noahwinslow3252 Ай бұрын
I'll admit I wasn't as interested in this one as your other work, but your animation quality is *chef's kiss* such a good presentation
@i_do_stuff
@i_do_stuff Ай бұрын
Waiting for the next one!
@P4INKillers
@P4INKillers Ай бұрын
This is an absolutely wonderful video. If I may provide some feedback; It would be great if you could visually show how these mutations (5:47) are applied using the network chart. When splitting an existing connection in two, do they share the same connections with their parents and children? Do new connections have random weights? Also, why does my hyperbolic tangent function provide values different from yours?
@kinsondigital
@kinsondigital 6 сағат бұрын
What would be neat is to take an AI model that has been trained in realist physics and see if it can be applied to balance a real-world physical pendulum. There are forces and things in real-world physics that you cannot account for in a software simulation. For example, there are electrical forces, such as wire resistance, with the electric motor that drives the cart. The friction forces of the rail and the cartwheels, forces of wind if the balance operation occurred in an outside windy environment, and more. It would be fun to build something like this and train a model to control a real-world pendulum!!
@teenspirit1
@teenspirit1 Ай бұрын
I do topological sorting, but then I cache all the pathways from input nodes to output nodes into lists. This way, instead of re-iterating the graph, I just do a for loop to iterate over lists of nodes instead of repeatedly recalculating paths. I haven't seen this technique used online but it makes training step much faster.
@Prism019
@Prism019 Күн бұрын
Yeah, that popped out to me as an immediate speedup opportunity. Just gotta make sure it's only valid while the topology of it doesn't change. (Maybe invalidate it in the "add node/connection" mutations)
@Leonan-cx6dl
@Leonan-cx6dl Ай бұрын
Waiting for the next video!
@thatprogramer
@thatprogramer Ай бұрын
Very well explained! I wonder how the network would react to slight random fluctuations in the value of the nodes or just straight up removing nodes (How would it adapt?)
@g3itnal
@g3itnal Ай бұрын
im excited for the next video
@shadowcrafter01
@shadowcrafter01 Ай бұрын
That's an awesome video. Crazy good graphics! Mind giving us a hint on how you made them?
@PezzzasWork
@PezzzasWork 21 күн бұрын
Thank you! I am using C++ and SFML, I will probably make a series of small tutorial to explain how I do this
@CyrilM68
@CyrilM68 Ай бұрын
I can't wait to see what happens next with the double pendulum !
@manamimnm
@manamimnm Ай бұрын
That trippy music!
@lennarth.6214
@lennarth.6214 Ай бұрын
I really like the NEAT-algorithm and its variations. I've used them to find shapes for the unsolved mathematical problem called moving sofa. I got something similar to the currently known best solution in just a few dozen iterations. I wonder how this algorithm scales with more complex task on just a few inputs.
@sourabhk2373
@sourabhk2373 13 күн бұрын
Videos like these remind me why I got into this field. Man my job is sucking the soul out of me. Gotta do something about this.
@geobruce1995
@geobruce1995 Ай бұрын
This was again an awesome and beautifully visualised video, just like I'm used from this channel. I'd love to be able to program something like this. If you were to make a more detailed tutorial that we can follow along with the videos and description I believe many people might benefit from this. Is your code open source? Thanks a lot for your awesome content!
@chrisdickens4862
@chrisdickens4862 Ай бұрын
Very cool!
@Alexander20091988
@Alexander20091988 Ай бұрын
Really cool video, thank you! This is an really interesting sub topic of ML, especially with such simple networks. Im wondering how it would play out, to create some intermediate game ai, which handles some decisions with this sort of mechanisms instead of a huge load of switch/if/else shenanigans. Obviously not driven fully by it for performance reasons, but in an assisting way. Btw, can you add the used resources (wiki/paper links) to the description? I would appreciate it. Thank you!
@Koroistro
@Koroistro 2 күн бұрын
I always found these systems fascinating, adding noise made me wonder about one thing: what if there was noise on the neurons themselves? In the real world neurons live in a chaotic systems too, so it stands to reason that there'd be sources of noise there too.
@ardumaniak
@ardumaniak Ай бұрын
Hurry up with the second part, I can't wait!
@synterr
@synterr Ай бұрын
So cool example! Can't wait to see how AI will handle chaotic pendulum ;)
@QwertyIsCool
@QwertyIsCool Ай бұрын
Hes back lets go!
@enderdodo9749
@enderdodo9749 2 күн бұрын
Very interesting video! The editing and animations are so nice and makes it easy to understand, and I was wondering, what software did you use to make them?
@bradley1995
@bradley1995 Ай бұрын
This video seems much simpler than your others. Although I hope a bit more math and code examples can be used in the next. Gate logic videos seem great to teach the subject aswell. Although I feel such simplicity makes it hard to understand the topic clearly enough to extend it to more complicated matters.
@happycolours8551
@happycolours8551 Ай бұрын
Yay he's back
@antoinespadone7834
@antoinespadone7834 Ай бұрын
amazing work and i hope mine will work
@motbus3
@motbus3 Ай бұрын
I'm still curious about the UIs :) anxiously waiting for the source code ❤
@quantumgaming9180
@quantumgaming9180 29 күн бұрын
I did not expect you to say "double pendulum" and now you are leaving us on a cliff hanger like this :( Hope next episode appears soon
@FunkyTurtle
@FunkyTurtle 29 күн бұрын
awesome video man, the graphics are super beautiful as always. you inspired me to make a network of my own, what sources did you use to learn the intricacies of the architecture? i understand the general flow but wouldn't know when at what rate should i add connections or nodes. thanks 😄
@PezzzasWork
@PezzzasWork 22 күн бұрын
Thank you! I did use the original paper a lot and then tweaked things a bit to feet my needs. In the end these parameters have quite a lot of flexibility, there is a wide range of possible values that can lead to good results. In this case I used 5% chance to create a new node and 50% chance to create a new connection.
@Antcode-wk7tu
@Antcode-wk7tu 9 күн бұрын
Hi Pezzza. I have got a question for a physics rigid body particle simulation you made ages ago, and I am dying to know since you didn’t upload the source code and can’t find what I need anywhere else. You have the feature where you are able to draw your own rigid bodies with the mouse. I believe the objects are composed of particles which are interconnected by constraints (correct me if I am wrong). I know how to implement everything apart from the constraint connections. How do I connect the particles in a way that works for any drawing and keeps the object's rigidity. A naive approach be to connect every particle to every other particle but that would suffer from performance issues. How did you implement it?
@julianxe
@julianxe 29 күн бұрын
Super insightful! What tool are you using for animations?
@PezzzasWork
@PezzzasWork 22 күн бұрын
I did create my own tool using C++ and SFML
@jazzargamer3064
@jazzargamer3064 2 күн бұрын
That's amazing. I really like what you have done here. Can you share some of the code used in this video? It would be appreciated.
@Surfingnet
@Surfingnet Ай бұрын
Encore une super vidéo. Tu l'as codé dans quel langage ce projet? C'est quoi le cpu de la machine sur laquelle tu fais tourner le processus de sélection?
@PezzzasWork
@PezzzasWork 21 күн бұрын
Merci ! J’utilise le C++ pour tous mes projets et le CPU de mon pc c’est un I7-12700K
@bergolho
@bergolho Ай бұрын
Congratulations for the video! Could you please tell me which software you use to build the animations ?
@PezzzasWork
@PezzzasWork 21 күн бұрын
Thank you! I am using a C++ tool I wrote myself
@ihv2010_cc
@ihv2010_cc Ай бұрын
YES :D
@mikelCold
@mikelCold Ай бұрын
What a hook!
@JoseFerreira-un2cl
@JoseFerreira-un2cl Ай бұрын
What did you use to make the animations?
@Gunnahan
@Gunnahan Ай бұрын
cant wait for part 2 🙂
@Banaannaa
@Banaannaa Ай бұрын
same
@gorlix
@gorlix Ай бұрын
after this video you convinced me to play around with neutral networks. i quickly found my first goal - make MNIST number recognition network. its my second day trying and the network consistently gets 30% error rate which really pisses me off, this must be because i did not use any libraries and slapped it together on a Unity C# project with a help of chat gpt. im planning to run network on a separate thread so i could test more variety of settings for the neural network. anyways if you are reading this, what would you suggest for me? im using traditional neural network with inputs of 784 hidden layer 128 hidden layer 32 output layer 10 and learning rate of 0,0005 in each epoch it eats 60k images after running first half of first learning epoch it shows 25-30% error rate, after second epoch error rate tends to move closer to 50% which is weird, i tried making learning rate smaller but that requires lots of time too
@Haapavuo
@Haapavuo Ай бұрын
How did you implement the visualization? It looks very nice. Thanks!
@PezzzasWork
@PezzzasWork 21 күн бұрын
I am using C++ and SFML, I will create a series of tutorials to explain how I did as I have quite a lot of questions about it.
@and_I_am_Life_the_fixer_of_all
@and_I_am_Life_the_fixer_of_all 28 күн бұрын
such a crime that one of the best youtubers in the tech space only has 138k views and only 34k views on this video after 7 days
@chris.hinsley
@chris.hinsley Ай бұрын
Was nice to see a none layered net ! But just a DAG net.
@jmcglockYT
@jmcglockYT Ай бұрын
yes he uploaded
@azuky74
@azuky74 29 күн бұрын
I wanted to do the same (create my own evolution neural network) for a long time and you gave me the motivation to ! Thank a lot Your video is really great ! Love it ! I have one question, on my side I have one issue. Network are get over complexed really fast, creating many neurons in fact not necessary. How did you managed this ? Do you decrease the chance to create a new neuron depending on the current number ? Do you take the size of the network in account when scoring ? Or maybe you didn't have this issue ! If anyone have an idea about it, I take it ! (I resolved the issue by decrasing the score depending on the network size, but I'm not feeling this is a good way to solve it)
@moofin4170
@moofin4170 Ай бұрын
In theory I understand training AI, however what software do you use? Where do you write logic? How do you get an image output? How do you offload the work to a GPU for faster matrix processing? Interesting stuff, nonetheless. Great video!
@FailRaceFan
@FailRaceFan Ай бұрын
I feel like I've learned more in this video than in 5 hours of reading. Will you also talk about other learning algorithms?
@PezzzasWork
@PezzzasWork 21 күн бұрын
Yes I will explore other methods!
@Stagnated541
@Stagnated541 Ай бұрын
What is the best compiler for a code made in Scratch?
@ErikBongers
@ErikBongers 2 күн бұрын
Are the mutations equally distributed between those 4 possibilities? But some extra mutation decisions need to be made: where to insert a new node, which weight to change or where to add a new connection. Are these decisions also equally distributed?
@LambOfDemyelination
@LambOfDemyelination Ай бұрын
how does the NEAT method you use use the reward function to optimise the network? Is that is a feature inherent to the NEAR method, or is it relying on extra work?
@PezzzasWork
@PezzzasWork 21 күн бұрын
My implementation is a simplification of neat but the global principle is the same and the reward function is just there to drive the random operations toward better solutions by introducing a biais for better agents, at the core of the algorithm there almost only random things happening.
@sergodobro2569
@sergodobro2569 Ай бұрын
Cool video! Btw, do you use Godot or some other engine? If though, how to calculate physical interactions in seconds? Because usually it is 1 scene with fixed speed of time, and to calculate all those ai decisions everything should be sped up and without graphics
@PezzzasWork
@PezzzasWork 21 күн бұрын
Thanks! I am using my own simple engine :)
@Radu
@Radu 20 күн бұрын
Nice one!
@PezzzasWork
@PezzzasWork 20 күн бұрын
Thank you! I am really impressed by your understand ai videos
@Radu
@Radu 9 күн бұрын
@@PezzzasWork you've seen those? Cool, thanks for watching :-)
@BanD1t8
@BanD1t8 25 күн бұрын
The pendulum visualization looks really nice and tactile. Is it custom made, or was there some library/framework involved?
@PezzzasWork
@PezzzasWork 22 күн бұрын
It's all custom made using C++ and SFML
@QQ-jn5jb
@QQ-jn5jb Ай бұрын
The talking chicken is amazing
@Gedestherosys
@Gedestherosys Ай бұрын
Can u give an example recommendation for a mobile app for this?
@gustavoadolfomelindres
@gustavoadolfomelindres Ай бұрын
Yay!!!
How to train simple AIs to balance a double pendulum
24:59
Pezzza's Work
Рет қаралды 52 М.
Why Does Diffusion Work Better than Auto-Regression?
20:18
Algorithmic Simplicity
Рет қаралды 161 М.
СҰЛТАН СҮЛЕЙМАНДАР | bayGUYS
24:46
bayGUYS
Рет қаралды 833 М.
ДЕНЬ РОЖДЕНИЯ БАБУШКИ #shorts
00:19
Паша Осадчий
Рет қаралды 6 МЛН
The Worlds Most Powerfull Batteries !
00:48
Woody & Kleiny
Рет қаралды 26 МЛН
Evolving AIs - Predator vs Prey, who will win?
12:15
Pezzza's Work
Рет қаралды 2,8 МЛН
Watching Neural Networks Learn
25:28
Emergent Garden
Рет қаралды 1,1 МЛН
What is Differentiable Programming
2:04
Numeryst
Рет қаралды 4,4 М.
AIs learn to WALK
20:21
Pezzza's Work
Рет қаралды 51 М.
The Most Impressive Scratch Projects
11:00
DenshiVideo
Рет қаралды 4,8 МЛН
Prey vs Predators - preparing bigger simulation
8:26
Pezzza's Work
Рет қаралды 78 М.
Understanding B-Trees: The Data Structure Behind Modern Databases
12:39
I Made a Neural Network with just Redstone!
17:23
mattbatwings
Рет қаралды 456 М.
Forget WiFi! This Wireless Method is WAY Better?
12:14
GreatScott!
Рет қаралды 416 М.
How charged your battery?
0:14
V.A. show / Магика
Рет қаралды 3,7 МЛН
ПК с Авито за 3000р
0:58
ЖЕЛЕЗНЫЙ КОРОЛЬ
Рет қаралды 1,9 МЛН
What model of phone do you have?
0:16
Hassyl Joon
Рет қаралды 77 М.
Индуктивность и дроссель.
1:00
Hi Dev! – Электроника
Рет қаралды 1,6 МЛН