How to train simple AIs

  Рет қаралды 60,601

Pezzza's Work

Pezzza's Work

Күн бұрын

This video is about a simple algorithm to experiment with basic AIs.
Thanks to Alexislouis for the music! @alexislouis2320
You can find the music here: / 18zvih9nrh8gtkjy9
Github github.com/johnBuffer/Pendulu...

Пікірлер: 265
@alexislouis2320
@alexislouis2320 Ай бұрын
Nice video my friend. I would stay around for the seconds parts guys, exciting things ahead ;)
Ай бұрын
fr
@mox189
@mox189 Ай бұрын
BASED
@GuildOfCalamity
@GuildOfCalamity Ай бұрын
I could be insane, but I would swear that a rooster just taught me AI.
@bradley1995
@bradley1995 Ай бұрын
He did, and a cock a doodle too!
@sebastianpohl1268
@sebastianpohl1268 7 күн бұрын
Twist at the end: The rooster was itself an AI ...🤔
@CraftingCat_IX
@CraftingCat_IX Ай бұрын
The talking chicken is *slightly* cursed. It’s probably because only the beak is moving and it’s opening a bit too wide for my taste.
@plaintext7288
@plaintext7288 Ай бұрын
+ the balls like red things
@the-bgrspot6997
@the-bgrspot6997 Ай бұрын
hyper cursed tbh
@poultrypants
@poultrypants Ай бұрын
and the balls 🤣🤣
@sumitbiswas164
@sumitbiswas164 Ай бұрын
Extremely distracting! I would prefer relevant scenes in a serious video.
@volbla
@volbla Ай бұрын
I like the chicken. I find it charming :>
@alliepiper4772
@alliepiper4772 Ай бұрын
I'm finally starting to recover from like 3 years of intense burnout as a software engineer, and watching your videos helps me remember why I got into this field in the first place. Looking forward to the next one!
@grahamsnyder762
@grahamsnyder762 Ай бұрын
Since the controller can output an arbitrary cart speed every timestep, it is permitted more or less infinite acceleration. It would be interesting to see how they perform if the available acceleration, (or power, or whatever) is constrained to realistic bounds
Ай бұрын
That's actually pretty standard to alter into a categorical/discrete step.
@knitnatsnokprogramming
@knitnatsnokprogramming Ай бұрын
He’s alive!
@thebetterbutter709
@thebetterbutter709 Ай бұрын
From a frenchmen to another, your accent has improved so much! Your videos are captivating as always.
@proyoloks1386
@proyoloks1386 Ай бұрын
yeah it's insane, I almost forgot that this is the same guy as 8 months ago...
@mr.ditkovich9983
@mr.ditkovich9983 Ай бұрын
Can't wait to see your next video 🙌🏾🙌🏾
@TheTechnopider
@TheTechnopider Ай бұрын
Extremely excited for the next video! For some reason, AI training videos just scratch a certain itch so nicely
@Oring17
@Oring17 Ай бұрын
Love your work Pezzza. You are a great inspiration.
@knitnatsnokprogramming
@knitnatsnokprogramming Ай бұрын
I’ll binge-watch this rn
@ruolbu
@ruolbu Ай бұрын
how do you binge a single 13 minute video?
@knitnatsnokprogramming
@knitnatsnokprogramming Ай бұрын
@@ruolbu By rewatching it over and over again at 0.25x speed
@PezzzasWork
@PezzzasWork Ай бұрын
Amazing
@ruolbu
@ruolbu Ай бұрын
dedication
@PloverTechOfficial
@PloverTechOfficial Ай бұрын
This is amazing! I can actually understand how to create my own system if I wanted. Unlike some videos which don’t succeed at telling us in an understandable way.
@Hailfire08
@Hailfire08 Ай бұрын
Love your videos and can't wait for the next one!
@xernas7880
@xernas7880 Ай бұрын
Finally ! I just love your content, i'm happy to see you again, also on my favorite topic
@mnajjar85
@mnajjar85 5 күн бұрын
the visualizations are epic
@notthetruedm
@notthetruedm Ай бұрын
I love how you animated this! It looks so cool and made it easy to follow along
@Ibloop
@Ibloop Ай бұрын
I was literally about to work on a project of mine that requires AI, immaculate timing pezzza
@dedelblute3946
@dedelblute3946 Ай бұрын
I love this channel. It's enjoyable to just watch cool coding stuff.
@issamoudriss6564
@issamoudriss6564 Ай бұрын
This video is super nice man, waitin for the second part!
@karlosfy
@karlosfy Ай бұрын
Really inspiring. Will be waiting to see the code! Great content :)
@simon_aviation
@simon_aviation Ай бұрын
Thank you SOOOO MUCH!!!! I always wanted to do something like this, this will really help!!!
@rigbyb
@rigbyb Ай бұрын
Great video! Glad to see you again
@elex6934
@elex6934 Ай бұрын
I love your videos ❤ ai is such an interesting topic and I'll watch part2 as soon as possible
@user-lm4nk1zk9y
@user-lm4nk1zk9y Ай бұрын
Now build entire ecosystem with Darwin's evolution principles.
@Maus_Indahaus
@Maus_Indahaus Ай бұрын
I'd like to see that!
@SystemBD
@SystemBD Ай бұрын
That is actually a branch of classical AI called Evolutionary/Genetic Algorithms. They are not hard to code, but they have limited applications.
@Me-0063
@Me-0063 Ай бұрын
@@SystemBDNot hard to code is an understatement. In my opinion, its probably the easiest to code from scratch…
@allanburns1190
@allanburns1190 Ай бұрын
I am actually working on something similar
@TVDaJa
@TVDaJa Ай бұрын
@@Me-0063 They sound to me like a normal neural network that uses random noise and a kind of selection instead of a more guided training algorithm
@JayBenOh
@JayBenOh Ай бұрын
Great video! It's a very nice visual representation ... that must have been a ton of work!
@namdao2672
@namdao2672 Ай бұрын
im trying to learn ML and DL by myself and find this super helpful, waiting for your next masterpiece
@srb9767
@srb9767 Ай бұрын
Your projects are amazing, and often very beautiful. I aspire to make software as good as this one day!
@Wolforce
@Wolforce Ай бұрын
Great video! as always!
@NickCombs
@NickCombs Ай бұрын
The first steps are always the hardest, so it might be good to show some actual code examples for them.
@CraftingCat_IX
@CraftingCat_IX Ай бұрын
The guy is back :D
@sourabhk2373
@sourabhk2373 Ай бұрын
Videos like these remind me why I got into this field. Man my job is sucking the soul out of me. Gotta do something about this.
@brickstopforall
@brickstopforall Ай бұрын
I was wanting a video on machine learning!! It's from you aswell!
@Sakejo
@Sakejo Ай бұрын
In the next videos I suggest including some articles, in the description, to delve deeper into the topics discussed. As I was searching for the sources for this project, I couldn't find them.
@ZeroPlus707
@ZeroPlus707 Ай бұрын
Great video! Hyped for the double pendulum :)
@loicsen8003
@loicsen8003 Ай бұрын
Very nice video, thanks for that
@gedaliakoehler6992
@gedaliakoehler6992 Ай бұрын
Very neat (haha)! Also great classical controls problem!
@midasscheffers7610
@midasscheffers7610 Ай бұрын
Awsom video, cant wait for the second part
@allanburns1190
@allanburns1190 Ай бұрын
This will actually help me so much in my new project
@motbus3
@motbus3 Ай бұрын
Loved the UIs
@khatharrmalkavian3306
@khatharrmalkavian3306 Ай бұрын
Double pendulum should be fun. I wonder how good a solution it will be able to find. As an aside, can't you just use the raw pendulum height (summed per frame) as a fitness function?
@wjrasmussen666
@wjrasmussen666 Ай бұрын
That is fun! Good work
@codedeus
@codedeus Ай бұрын
Great video as usual :D
@abdulrahmanelawady4501
@abdulrahmanelawady4501 Ай бұрын
Thank you for a great video
@marcelob.5300
@marcelob.5300 Ай бұрын
Wonderful!
@Blooper1980
@Blooper1980 Ай бұрын
Very neat video
@MysteryPancake
@MysteryPancake Ай бұрын
nice! it reminds me of the MarI/O video, it uses this algorithm too
@sofia.eris.bauhaus
@sofia.eris.bauhaus Ай бұрын
inverted double pendulum sounds intense! looking forward to it. :)
@i_do_stuff
@i_do_stuff Ай бұрын
Waiting for the next one!
@enderdodo9749
@enderdodo9749 23 күн бұрын
Very interesting video! The editing and animations are so nice and makes it easy to understand, and I was wondering, what software did you use to make them?
@yraharchenko6364
@yraharchenko6364 Ай бұрын
soooo, now I want to watch the next video, it is so excited
@Leonan-cx6dl
@Leonan-cx6dl Ай бұрын
Waiting for the next video!
@ScienceGuides
@ScienceGuides Ай бұрын
Great work! :-)
@CyrilM68
@CyrilM68 Ай бұрын
I can't wait to see what happens next with the double pendulum !
@kinsondigital
@kinsondigital 20 күн бұрын
What would be neat is to take an AI model that has been trained in realist physics and see if it can be applied to balance a real-world physical pendulum. There are forces and things in real-world physics that you cannot account for in a software simulation. For example, there are electrical forces, such as wire resistance, with the electric motor that drives the cart. The friction forces of the rail and the cartwheels, forces of wind if the balance operation occurred in an outside windy environment, and more. It would be fun to build something like this and train a model to control a real-world pendulum!!
@g3itnal
@g3itnal Ай бұрын
im excited for the next video
@teenspirit1
@teenspirit1 Ай бұрын
I do topological sorting, but then I cache all the pathways from input nodes to output nodes into lists. This way, instead of re-iterating the graph, I just do a for loop to iterate over lists of nodes instead of repeatedly recalculating paths. I haven't seen this technique used online but it makes training step much faster.
@Prism019
@Prism019 21 күн бұрын
Yeah, that popped out to me as an immediate speedup opportunity. Just gotta make sure it's only valid while the topology of it doesn't change. (Maybe invalidate it in the "add node/connection" mutations)
@chrisdickens4862
@chrisdickens4862 Ай бұрын
Very cool!
@manamimnm
@manamimnm Ай бұрын
That trippy music!
@Koroistro
@Koroistro 22 күн бұрын
I always found these systems fascinating, adding noise made me wonder about one thing: what if there was noise on the neurons themselves? In the real world neurons live in a chaotic systems too, so it stands to reason that there'd be sources of noise there too.
@happycolours8551
@happycolours8551 Ай бұрын
Yay he's back
@QwertyIsCool
@QwertyIsCool Ай бұрын
Hes back lets go!
@noahwinslow3252
@noahwinslow3252 Ай бұрын
I'll admit I wasn't as interested in this one as your other work, but your animation quality is *chef's kiss* such a good presentation
@shadowcrafter01
@shadowcrafter01 Ай бұрын
That's an awesome video. Crazy good graphics! Mind giving us a hint on how you made them?
@PezzzasWork
@PezzzasWork Ай бұрын
Thank you! I am using C++ and SFML, I will probably make a series of small tutorial to explain how I do this
@P4INKillers
@P4INKillers Ай бұрын
This is an absolutely wonderful video. If I may provide some feedback; It would be great if you could visually show how these mutations (5:47) are applied using the network chart. When splitting an existing connection in two, do they share the same connections with their parents and children? Do new connections have random weights? Also, why does my hyperbolic tangent function provide values different from yours?
@synterr
@synterr Ай бұрын
So cool example! Can't wait to see how AI will handle chaotic pendulum ;)
@ihv2010_cc
@ihv2010_cc Ай бұрын
YES :D
@quantumgaming9180
@quantumgaming9180 Ай бұрын
I did not expect you to say "double pendulum" and now you are leaving us on a cliff hanger like this :( Hope next episode appears soon
@bradley1995
@bradley1995 Ай бұрын
This video seems much simpler than your others. Although I hope a bit more math and code examples can be used in the next. Gate logic videos seem great to teach the subject aswell. Although I feel such simplicity makes it hard to understand the topic clearly enough to extend it to more complicated matters.
@antoinespadone7834
@antoinespadone7834 Ай бұрын
amazing work and i hope mine will work
@mikelCold
@mikelCold Ай бұрын
What a hook!
@Gunnahan
@Gunnahan Ай бұрын
cant wait for part 2 🙂
@Banaannaa
@Banaannaa Ай бұрын
same
@motbus3
@motbus3 Ай бұрын
I'm still curious about the UIs :) anxiously waiting for the source code ❤
@jmcglockYT
@jmcglockYT Ай бұрын
yes he uploaded
@Radu
@Radu Ай бұрын
Nice one!
@PezzzasWork
@PezzzasWork Ай бұрын
Thank you! I am really impressed by your understand ai videos
@Radu
@Radu Ай бұрын
@@PezzzasWork you've seen those? Cool, thanks for watching :-)
@alessi4249
@alessi4249 Ай бұрын
Yeah.. the talking cockerel with sunglasses talking about NN is weirding me out.. Great video!
@gustavoadolfomelindres
@gustavoadolfomelindres Ай бұрын
Yay!!!
@QQ-jn5jb
@QQ-jn5jb Ай бұрын
The talking chicken is amazing
@ryshask
@ryshask Ай бұрын
Talking chicken? I'm in!
@and_I_am_Life_the_fixer_of_all
@and_I_am_Life_the_fixer_of_all Ай бұрын
such a crime that one of the best youtubers in the tech space only has 138k views and only 34k views on this video after 7 days
@jayearl3591
@jayearl3591 Ай бұрын
So after all these months in hiding, you've been secretly building Boston Dynamics Spot knock-offs 😂
@geobruce1995
@geobruce1995 Ай бұрын
This was again an awesome and beautifully visualised video, just like I'm used from this channel. I'd love to be able to program something like this. If you were to make a more detailed tutorial that we can follow along with the videos and description I believe many people might benefit from this. Is your code open source? Thanks a lot for your awesome content!
@ardumaniak
@ardumaniak Ай бұрын
Hurry up with the second part, I can't wait!
@chris.hinsley
@chris.hinsley Ай бұрын
Was nice to see a none layered net ! But just a DAG net.
@thatprogramer
@thatprogramer Ай бұрын
Very well explained! I wonder how the network would react to slight random fluctuations in the value of the nodes or just straight up removing nodes (How would it adapt?)
@Yeetmaster982
@Yeetmaster982 Ай бұрын
im exited to see it with a double pendulum
@Alexander20091988
@Alexander20091988 Ай бұрын
Really cool video, thank you! This is an really interesting sub topic of ML, especially with such simple networks. Im wondering how it would play out, to create some intermediate game ai, which handles some decisions with this sort of mechanisms instead of a huge load of switch/if/else shenanigans. Obviously not driven fully by it for performance reasons, but in an assisting way. Btw, can you add the used resources (wiki/paper links) to the description? I would appreciate it. Thank you!
@tatomans1982
@tatomans1982 23 сағат бұрын
excelent video. I learn a lot. Do you have any video where you explain the code?
@jazzargamer3064
@jazzargamer3064 23 күн бұрын
That's amazing. I really like what you have done here. Can you share some of the code used in this video? It would be appreciated.
@Antcode-wk7tu
@Antcode-wk7tu 29 күн бұрын
Hi Pezzza. I have got a question for a physics rigid body particle simulation you made ages ago, and I am dying to know since you didn’t upload the source code and can’t find what I need anywhere else. You have the feature where you are able to draw your own rigid bodies with the mouse. I believe the objects are composed of particles which are interconnected by constraints (correct me if I am wrong). I know how to implement everything apart from the constraint connections. How do I connect the particles in a way that works for any drawing and keeps the object's rigidity. A naive approach be to connect every particle to every other particle but that would suffer from performance issues. How did you implement it?
@FailRaceFan
@FailRaceFan Ай бұрын
I feel like I've learned more in this video than in 5 hours of reading. Will you also talk about other learning algorithms?
@PezzzasWork
@PezzzasWork Ай бұрын
Yes I will explore other methods!
@lennarth.6214
@lennarth.6214 Ай бұрын
I really like the NEAT-algorithm and its variations. I've used them to find shapes for the unsolved mathematical problem called moving sofa. I got something similar to the currently known best solution in just a few dozen iterations. I wonder how this algorithm scales with more complex task on just a few inputs.
@FunkyTurtle
@FunkyTurtle Ай бұрын
awesome video man, the graphics are super beautiful as always. you inspired me to make a network of my own, what sources did you use to learn the intricacies of the architecture? i understand the general flow but wouldn't know when at what rate should i add connections or nodes. thanks 😄
@PezzzasWork
@PezzzasWork Ай бұрын
Thank you! I did use the original paper a lot and then tweaked things a bit to feet my needs. In the end these parameters have quite a lot of flexibility, there is a wide range of possible values that can lead to good results. In this case I used 5% chance to create a new node and 50% chance to create a new connection.
@kojox
@kojox Ай бұрын
babe wake up, we got to watch this now
@azuky74
@azuky74 Ай бұрын
I wanted to do the same (create my own evolution neural network) for a long time and you gave me the motivation to ! Thank a lot Your video is really great ! Love it ! I have one question, on my side I have one issue. Network are get over complexed really fast, creating many neurons in fact not necessary. How did you managed this ? Do you decrease the chance to create a new neuron depending on the current number ? Do you take the size of the network in account when scoring ? Or maybe you didn't have this issue ! If anyone have an idea about it, I take it ! (I resolved the issue by decrasing the score depending on the network size, but I'm not feeling this is a good way to solve it)
@Aannoonnnn
@Aannoonnnn Ай бұрын
G ❤️🔥
@zyro8473
@zyro8473 Ай бұрын
+1 for part 2
@bergolho
@bergolho Ай бұрын
Congratulations for the video! Could you please tell me which software you use to build the animations ?
@PezzzasWork
@PezzzasWork Ай бұрын
Thank you! I am using a C++ tool I wrote myself
@user-ns7fz5gb5p
@user-ns7fz5gb5p Ай бұрын
Nice work! Is it possible that you publish this project would very interesting to read the code.
@PezzzasWork
@PezzzasWork Ай бұрын
It is planned, I am currently cleaning the code
@user-ns7fz5gb5p
@user-ns7fz5gb5p Ай бұрын
@@PezzzasWorkThanks
@julianxe
@julianxe Ай бұрын
Super insightful! What tool are you using for animations?
@PezzzasWork
@PezzzasWork Ай бұрын
I did create my own tool using C++ and SFML
@moofin4170
@moofin4170 Ай бұрын
In theory I understand training AI, however what software do you use? Where do you write logic? How do you get an image output? How do you offload the work to a GPU for faster matrix processing? Interesting stuff, nonetheless. Great video!
How to train simple AIs to balance a double pendulum
24:59
Pezzza's Work
Рет қаралды 144 М.
Why Does Diffusion Work Better than Auto-Regression?
20:18
Algorithmic Simplicity
Рет қаралды 205 М.
ИРИНА КАЙРАТОВНА - АЙДАХАР (БЕКА) [MV]
02:51
ГОСТ ENTERTAINMENT
Рет қаралды 5 МЛН
Why You Should Always Help Others ❤️
00:40
Alan Chikin Chow
Рет қаралды 138 МЛН
Super gymnastics 😍🫣
00:15
Lexa_Merin
Рет қаралды 107 МЛН
Forget WiFi! This Wireless Method is WAY Better?
12:14
GreatScott!
Рет қаралды 464 М.
Better Mountain Generators That Aren't Perlin Noise or Erosion
18:09
Josh's Channel
Рет қаралды 302 М.
Actually, Maybe There's Only 1 Game of Tic-Tac-Toe
11:58
Marc Evanstein / music․py
Рет қаралды 1 МЛН
Much bigger simulation, AIs learn Phalanx
29:13
Pezzza's Work
Рет қаралды 2,6 МЛН
AI Learns to Escape (deep reinforcement learning)
8:18
AI Warehouse
Рет қаралды 7 МЛН
I Made a Neural Network with just Redstone!
17:23
mattbatwings
Рет қаралды 657 М.
Turning bugs into Art
7:43
Pezzza's Work
Рет қаралды 194 М.
I Built a Neural Network from Scratch
9:15
Green Code
Рет қаралды 124 М.
Making a difficult game about fitting in - Acerola Jam 0
19:17
jess::codes
Рет қаралды 237 М.
Samsung Galaxy 🔥 #shorts  #trending #youtubeshorts  #shortvideo ujjawal4u
0:10
Ujjawal4u. 120k Views . 4 hours ago
Рет қаралды 11 МЛН
#miniphone
0:16
Miniphone
Рет қаралды 3,6 МЛН
Телефон в воде 🤯
0:28
FATA MORGANA
Рет қаралды 1,2 МЛН