Can AI make another AI? Using ChatGPT to make an AI bot

Рет қаралды 104,644

Жыл бұрын

We team up with ChatGPT to make an AI bot that can play the Flappy Bird game. Flappy Bird is a relatively simple game with few inputs and only one output. More sophisticated bots take in a larger number of inputs and can have many potential outputs.
Game developed in Unity
This was all done with ChatGPT-4
ChatGPT chose to use the Unity ML-Agents framework
We made Flappy Bird in a previous video using ChatGPT here: • Can AI code Flappy Bir...
I want to emphasize two questions from the Q&A at the end of the video:
Q: Is it safe to use AI to make more AI?
A: In the context of using AI to make bots for games, for sure - because the inputs and outputs are totally controlled. In the more general case - hard to say. These are powerful tools we can use to make more tools, but we should be careful with what inputs and output we provide them.
Q: You’re a game developer - are you condoning the use of bots?
A: Bots are a tool and can be used for a lot of things. If players are using bots to exploit games, gain an unfair advantage, or ruin somebody else’s experience, that’s not good. But bots can also serve positive uses such as being your targets in a PvE game, fun to practice against for a PvP game, provide a friendlier tutorial experience, or fill in for a teammate when they disconnect
-----
Discuss this video and chat about game development on my discord server / discord
I stream gam jams on twitch / candlesan
Twitter: / candlesan
This is Wyatt Cheng’s personal channel. In my day job I serve as Game Director at Blizzard Entertainment. This channel is an independent endeavor and not related to my employer in any way. The opinions expressed are my own and do not necessarily reflect those of my employer.

Пікірлер: 176

@archonthewizard Жыл бұрын

I'm blown away by how much information you're able to pack into these short videos. It has the welcome side effect of making them very enjoyable.

@candlesan Жыл бұрын

Thanks Archon!

@davec817 Жыл бұрын

this guys gotta be a teacher the way he explains and details information is on another level

@earomc Жыл бұрын

Yeah, he is just so thorough with explaining things. He splits up more complicated things into smaller easily digestible things. And he's really good at that too

@candlesan Жыл бұрын

Thank you! If there are any specific topics on game design or game development you'd be interested in learning more about please let me know.

@zardify_ Жыл бұрын

@candlesan Hey! I have one! We all know a game feels good to play if it's 1. Responsive. 2. Fluid. 3. Impactful. How to, and what makes combat all these things? In theory mostly, as I don't think you'd have many examples to show. There are certainly animation tricks, sound tricks, even code tricks (for example action queues to make sure input is registered) camera and framing techniques and I'd imagine many more. I'm not sure anyone with similar experiences to yours have talked about this. Probably not even close! There are some videos on what makes a game feel good, but most of them don't touch on technicalities or components of these at all.

@Niko_3D Жыл бұрын

@@candlesan Would be cool to get some insights into blizzard workflows! :P

@antonquirgst2812 5 ай бұрын

@@candlesan How did you make the bot see... i know its against ToS but I wanted to make a bot playing Diablo (not to exploit anything, but just to see if I could do it) but didnt have an idea on how to make the bot "see" the environment/the map - information of the game while playing is somewhere in the RAM memory where I wouldnt want to access it... since i did not have an idea i was also somewhat unable to make a proper prompt to chat gpt...

@shadowdemonaer Жыл бұрын

The way it rationalized "can't hit pipe if pipe not there" is the funniest thing in the world to me and a whole mood.

@DJWESG1 Жыл бұрын

Ceci n'est pas une pipe

@tobiaskarlsson7565 Жыл бұрын

Most reinforcement learning algorithms are actually quite likely to come up with a lot of glitches for any given game :) This is due to them spending the first few thousand iterations basically trying every possible action for every state it finds itself in, as it's still not trained enough to recognize any action as likely being better than any other. So training an RL agent on a game could be a good way to discover new speedrun techniques 😅

@NielNielJP Жыл бұрын

People like you are very few in this world. Thanks for doing what you've been doing.

@BenPanna Жыл бұрын

absolutely

@dtayt1 Жыл бұрын

facts

@bassism Жыл бұрын

There’s something beautiful about the way that the AI-written bot beat the game with an exploit in less than a second… Might not bode well for the future lol.

@shadowdemonaer Жыл бұрын

I found it super funny and a whole mood. And also I think this is good because it means you can use bots as players to test for exploitation in your games. if they are able to get somewhere they shouldn't, you need to correct that so they can't do it anymore. Pretty cool!

@shandonprobst9685 Жыл бұрын

As someone who's trying to find their footing in the vast world of game development, I have REALLY been appreciating your videos. Super well structured and insightful. It's also been really interesting to see these last couple of videos where you've utilized ChatGPT to work as an assistant in your programming. A lot of people are scared of how capable AI has become in the last few years but I feel that there's a lot of good that has come out of it as well. Thank you for your work and I look forward to the next video!

@tropical2153 Жыл бұрын

Wow your video is so high quality man keep up the good work, it’s all so well structured, dynamically edited and well explained, you’re gonna go far

@therealhussein Жыл бұрын

I like how you explain things, i know alot of the concepts that you explained but your explanation didn't make me get bored and made me continue through the video

@BenPanna Жыл бұрын

that's amazing that you could create a game, and you still stick around with flappy bird, keep your track, thanks!

@goma8167 Жыл бұрын

Excellent video. I need to get into machine learning it seems so fun. Especially within Unity. I swear, every single ChatGPT video should have a ChatGPT counter to know who said it the most.

@MyChunkyGoose Жыл бұрын

These videos are super engaging, keep em coming!

@hurtigejler3264 Жыл бұрын

I came about your video by shere luck, and thank the algorithm for that! Your videos are high quality and interesting. Also your voice is very pleasant to listen to and you seem like a very intelligent and nice guy. This is great! Thanks for doing this!

@theyAreGhost Жыл бұрын

Insanely high quality content I wonder if he produces everything himself. You rock candlesan!

@joshuadittmer Жыл бұрын

Man this video is great. Love the way you produce vids and explain things ❤

@coltonroetker4771 Жыл бұрын

It actually amazes me how much in common AI has with humans. I did the exact same thing on the original flappy bird back in the day. As soon as I started the game I tried going straight up to see if the dev messed that up lmao.

@DrShauryaGarg Жыл бұрын

Simply wow! Everytime I am just amazed with what you do with chatgpt. Creative and brilliant.

@yahyaelhakmaoui Жыл бұрын

youtube lacks this type of educational content really thank you for your videos

@0AThijs Жыл бұрын

Great teaching, especially with the amazing visual examples. Thanks 'Reynor' ❤️

@Vichion Жыл бұрын

I think there should be a neural network you can train to play for you in some games, that way if you stop playing or become unable to play, your friends can still enjoy the experience of playing with you. As an example Steep has "ghosts", aka a recorded session of your session in a challenge, and whenever I miss my best friend who is unfortunately no longer with us, I can boot it up and play with him again. It would be a bit more exciting if there was a neural network that imitated his playstyle however for some variation. :)

@jackytran6540 Жыл бұрын

Amazing teacher and tutorial, your explanations are so clear! Subscribed!!!

@ECHO-Gaming Жыл бұрын

Very well produced video. I am impressed. 🎉

@LinfordMellony Жыл бұрын

Thanks for sharing this! Aside from this, we've also seen the autonomous AI agents from another video which you can use on another game. I've seen also that AI can be used on Unity and you can choose the different sources like images from Bluewillow AI for example.

@MightyUncleKen Жыл бұрын

Amazing content about game development with ChatGPT ! thanks again for posting.

@Auroticz Жыл бұрын

I really enjoy your AI videos. It’s helping me learn code a lot! Thanks, candlesan.

@JohnZackYT Жыл бұрын

Youre a really underrated youtuber, Nice video!

@Okiwan3 Жыл бұрын

TFW you realize Raynor was named after Jimmy 😭

@Gomace Жыл бұрын

It'd be great if, in the future, if someone disconnected from an online game, we'd get an AI controlled bot that has been trained on that individual's games, and plays pretty much like they would have.

@QuadraTwo Жыл бұрын

Hey Wyatt, awesome video as usual. As someone who is quite new to games development and super eager and motivated, I really appreciate your insight & experience into issues like AI in games development etc... Since I am not really great at programming, I will most likely have to rely on the help of AI to create all the games that I have been envisioning all over the years.

@TheQAngren Жыл бұрын

Awsome video. Now I want to start making things with chatGPT :) Keep up the good work 👍

@DigitalWeenie Жыл бұрын

Excellent video and very interesting content. Cant begin to imagine how you wrapped your head around this stuff.

@jesse2535 Жыл бұрын

Your videos are great and more game devs should post on youtube about game development.

@MANIAKRA Жыл бұрын

This is an amazing channel. Thank you for sharing :)

@rahulshendre7089 Жыл бұрын

your explanation is just epic :)

@thetransferaccount4586 Жыл бұрын

these videos are super fun. it would be great if you showed the entire coding process, i bet there is lot to learn from it

@mmmmmmichael Жыл бұрын

Please make 10,000 more of these. Subbed up, 👍

@lachlan7181 Жыл бұрын

I think you should keep making these AI game dev videos they're really good

@alois7706 Жыл бұрын

Awesome really awesome content. Please complete this quality content!

@antares3030 Жыл бұрын

actually stellar content!

@i2Sekc4U Жыл бұрын

Excellent tutorial. Would appreciate if you compiled all the prompts and all the replies by ChatGPT into a github or zip archive somewhere we could access. You’re really good at teaching concepts! One thing I wished we saw was how did you do the 50k, 150k, 300k, etc.. training sessions. I was a bit confused there

@Gustafonair Жыл бұрын

This was a great video!

@nj8833 11 ай бұрын

One benefit of bots in gaming you didn't mention is one that you demonstrated - they can find exploits! Sure, the exploit it found at the beginning of the video might have been easily found with human bug crawling, but in the future, who knows how much more powerful this tool could be

@Wildboy_falcon Жыл бұрын

Idk why you don’t even have 250k?!?! 😅😂 you are a VERY good youtuber. Love to you man ❤

@bigbarttify Жыл бұрын

Well done wideo :)

@JustArtsCreations Жыл бұрын

Love it this is some out of the box thinking right here!

@JustArtsCreations Жыл бұрын

Id also love to see the troubleshooting done as well with those errors maybe in a side video?

@boxiboxi2173 Жыл бұрын

my dad gotta be proud after he knows i actually learn something from being on the computer all day

@user-jv4gj2jj3w Жыл бұрын

Hey Candlesan, with the rapid evolution of AI, I'm seriously considering creating an app with Chatgpt-4 and other plugins. However, I'm an amateur when it comes to coding. It would be really cool if you could provide a video or an answer explaining what level of knowledge is required to code an app with Chatgpt-4 on your own, if possible. In my case, i only want to design the app and give options and informations professionally

@Ferio_ Жыл бұрын

Awesome video ;)

Жыл бұрын

very engaging

@MissingTex Жыл бұрын

this is amazing i really wanna play/watch it play for me

@tobiaskarlsson7565 Жыл бұрын

It's potentially confusing that you first say the agent will be trained using RL, but then describe what basically sounds kinda like genetic algorithms :) I understand that trying to explain gradients and fitting to predict actions for value would be way, way too technical for these types of videos, but I'm not sure that describing an entirely different type of algorithm instead is the best way to do it :) That said, I do like both this and the previous video a lot! They're very entertaining :)

@candlesan Жыл бұрын

This is a great point! Thank you for bringing it up. I was trying to think of good ways to teach the concept in ways anybody could understand without getting into neural network diagrams or showing and math. I don't want to spread misinformation so I have made some cuts to the video to remove the parts that would be better thought of as GA rather than RL. Thank you for pointing this out. For anybody visiting this comment later, the deleted section featured highly rewarded birds "mating" to produce offspring. In retrospect the Raynor example is likely sufficient and my "mating" illustrations risk leaving people with the wrong impression on an already complex subject.

@Lykyk Жыл бұрын

Careful about the roll-over command with dogs, especially dogs with deep chests, as it can lead to gastric dilatation volvulus, which is very serious and very deadly if not recognized and operated fast. Every minute counts, so if your dog starts dry heaving, panting and has a hardened stomach, go to the vet immediately. Even if you just suspect it, it's better to go twice for nothing than lose your dog.

@gabrielpauna62 Жыл бұрын

😂😂😂😂 are you the ai from metal gear solid

@henrymorgan5204 Жыл бұрын

this is a gem of a videa

@misterandylink Жыл бұрын

That original exploit was perfect. I was like "Yo did it literally find the true solution?"

@fitybux4664 Жыл бұрын

Did you try walking backward from the starting point in the game? 😀

@meguru420 Жыл бұрын

The ai has to play the game only with the input state of moving up and forward with its wings. The location of the pipe's empty space needs to be recognized by receiving an image, but I don't know if it's possible.

@candlesan Жыл бұрын

The bot isn't looking at the screen, it's look at the game's internal simulation. As players we see pixels on a screen, but to a bot the world is represented by objects with co-ordinates in space.

@Vinnsmoke69 Жыл бұрын

i like how his voice audio doesn't change when his outside and inside home.

@nnamdin3372 Жыл бұрын

You're a legend

@Smabverse Жыл бұрын

Finally an AI video that's actually interesting again :D

@Ronthedon485 Жыл бұрын

Thats sick

@---Vi--- Жыл бұрын

Very very interesting.

@AsoSnT Жыл бұрын

so cool !

@ricosrealm Жыл бұрын

Nice video! A simple way to make it take a whole lot less time to train is tweak the reward function to give a higher reward the closer it gets to the middle of the pipe gap. I think it would become super-human really quickly!

@tobiaskarlsson7565 Жыл бұрын

You may very well end up with a bird dive-bombing pipes in order to pass through the center 😂 Also, as you're not training to maximize the immediate value, but the total future value of any given action, you're better off not artificially restricting the state space. You could end up eliminating a possible future state that would've otherwise had a very high-value action.

@gabrielpauna62 Жыл бұрын

@tobiaskarlsson7565 how did you get into ML I'd like to pick up some resources , I'm a dev

@tobiaskarlsson7565 Жыл бұрын

@@gabrielpauna62 I'm not entirely sure, to be honest 🤔 I would probably say I picked up a foundation from "Deep learning with Python" by F. Chollet, and then I started playing around with environments etc from Deepmind.

@NeCoNLive Жыл бұрын

You are awesome :D

@jxw7196 Жыл бұрын

Excellent!!!!!!!!!!!!!

@RedOctober2226 Жыл бұрын

Loved the story with the dog training, it is similar, and not. I loved that the AI 'immeadiately' cheesed the game. The other thing that I thought about the training models is not just generations of best performance, but also mutations to the bird-brains. Sometimes happy accidents can be helpful too. But that's a whole other topic, maybe by an AI expert.

@ricosrealm Жыл бұрын

It's the most natural way for the bot to cheat because it will likely spam the fly button when it is starting out since it has no concept of what to do other than keep flying.

@sioneris1545 Жыл бұрын

It would be nice to have a video on art generation for small prototype games

@josueC235 Жыл бұрын

Chino tenías que ser! Que grande ❤

@arqamkhawaja Жыл бұрын

Waiting for more AI game videos. Love from Kashmir 🍁

@TopX5s Жыл бұрын

You are so wholesome!

@deddykosasih387 Жыл бұрын

You make it look easy that I want to learn AI 😅. Is it possible to see/download the code for the bot? If we want to get a bot to learn a simple game without the game source code, would it be possible?

@Yocairo Жыл бұрын

Cool video. Your voice sounds a bit robotic due to what I presume is some post-effects.

@0xibex Жыл бұрын

This man shows us the example of how Skynet developed

@WanliLoo Жыл бұрын

keep it up boss!

@WanliLoo Жыл бұрын

really clean prompts ngl

@KVI3I Жыл бұрын

at this point i dont want to call you candlesan.... you are CANDLE SENPAI :D teach us more pls its so interesting and you explaint everything very good

@datguycloudy Жыл бұрын

ChatGPT coded a way for people to find your channel.

@huzaijack4282 Жыл бұрын

Candlesan has mastering AI chat bot that he soon will be the representative for the AI.

@rgtstudio911 Жыл бұрын

nice video

@JustFeral Жыл бұрын

That text box design is gonna have Nintendo trying to sue you lmfao

@EmaManfred Жыл бұрын

You could assign an AI agent/agent GPT to try and learn and create another AI. Basically, an AI learning and creating another AI. A lot of AIs could make use of it especially for the those that utilizes deep learning like singular task AIs like Bluewillow AI among others.

@sanmar6292 Жыл бұрын

Seems like AI bots will also be a great tool for playtesting / bug finding in the not so far future.

@Join_My_Teligram_channel Жыл бұрын

Just wow 😮😮

@antukin5469 Жыл бұрын

my favorite programmer

@Suomioz78 Жыл бұрын

I guess what the question of fear is, can eventually all AI bots trained for various tasks connect their knowledge and breed? Or are they individuals like humans? But eventually workout how to share their knowledge?

@bettyogbode8472 Жыл бұрын

He killed me when he said bird brains

@Nightstalker314 Жыл бұрын

I remember that in the early 2000s with games like Farcry and Crisis pushing the envelope there was a lot of press talk about the enemy AI and their reactions to the players performance. How far has this advanced by now? Not just in terms of combat but also creating immersive RPG worlds? Or is it just too broad to create a cohesive experience. Lately RPGs leaned heavier into progression paths and reputation with NPCs etc but those mostly fall into scripted outcomes. The only genre where I at least saw discussions about the opponent AI topic lately were racing games. Might be personal bias or lack of a broader experience but: Where are we in terms of AI reacting to players actions as part of the gaming experience? Edit: the Google AI once had showmatches against players in Starcraft 2 (and then there is also Chess and Go), but outside of these incidents I haven't noticed much talk about opponent AI development. WoW had the Island expedition and Warfront as well as PvP brawl AI features but those still feel like a locally obvious script compared to a globally scripted encounter.

@candlesan Жыл бұрын

AI is a fairly general term but I'll comment from two different angles in response to your question (but there are other meanings as well) - AI has advanced an enormous amount for games since Farcry and Crysis but the important note here is that "super realistic behaviors" isn't what you're looking for in many games. The objective is usually an illusion of realism with meaningful and fun gameplay experiences for the player. - There is extensive opponent AI development, it just doesn't make headline news, but there is definitely development of AI opponents for almost all games out there whether it be connect-4, poker, etc or computer games like FIFA or Fortnite