Using Image Recognition to play Mario Party Minigames

Рет қаралды 137,756

Күн бұрын

To try everything Brilliant has to offer-free-for a full 30 days, visit brilliant.org/CodeNoodles. The first 200 of you will get 20% off Brilliant’s annual premium subscription.
Here we go again, it's image recognition time! In this video I write some Python scripts to automate a couple of minigames from Mario Party DS. It was an absolute blast and we managed to achieve some pretty impressive scores. If you like this video, consider subscribing to support the channel!
This video was sponsored by Brilliant
LINKS
▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀
Support the channel: ko-fi.com/codenoodles
Itch.io: codenoodles.itch.io/
GitHub: github.com/OfficialCodeNoodles
MUSIC
▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀
Shoutout to ‪@TheNobleDemon‬ for making awesome video game music remixes! Check out their channel if you liked the music in this video!
• Super Mario Sunshine: ...
• Super Mario RPG: Bewar...
• Super Mario Land 2: At...
█▀ █ █ █▄▄ █▀ █▀▀ █▀█ █ █▄▄ █▀▀
▄█ █▄█ █▄█ ▄█ █▄▄ █▀▄ █ █▄█ ██▄

Пікірлер: 302

@CodeNoodles 11 ай бұрын

To try everything Brilliant has to offer-free-for a full 30 days, visit brilliant.org/CodeNoodles. The first 200 of you will get 20% off Brilliant’s annual premium subscription.

@lio1234234 11 ай бұрын

Fun fact, I learned on Brilliant that the polygon method you describe in the video to approximate a circle, is also how we calculate (or rather approximate) Pi!

@lio1234234 11 ай бұрын

Given that the definition of Pi is the area of a unit circle that is

@doggo7078 11 ай бұрын

how can I learn to program like you do? I'd make my hobby so much easier. I'm trying to find an rng seed with a certain pattern, but if I enter the minigame and reset for a new seed I take 15 seconds (with the emulator sped up), so math tells me I need to check 10k seeds if I want to find 2,5 suitable seeds (=5k for 1ish seed), which would take 4 hours and several PCs running 3 emulators at the same time. And I'd have to check 5 PCs to see if I found the seed during 4 hours, that's why it'd be useful if I was to learn how to write some code and recognize the rng pattern I'm looking for

@PikTheRedPikAUTTP 11 ай бұрын

how tf does math have to do with mario

@BarterChain65_Gaming 8 ай бұрын

what are you using to code with i'm trying to get into learning a bit of coding myself

@SpaciousBoundary 11 ай бұрын

It’s really telling just how impossible it is to win against expert difficulty when even the automated code only just wins

@KatherynneF 11 ай бұрын

To be fair, even as a kid I was faster than the code for the dominos game and humans can cut corners and won’t stop to turn on the drawing one. We can see multiple inputs ahead and play around that

@mistorbear 10 ай бұрын

well near the end the ai accidentally grabbed a bob-omb so that could be the reason

@jblen 10 ай бұрын

I mean it's automated code Vs automated code. Maybe they cheated a little because the game AI can see the code, but it's still not limited to human reaction times

@AdaTheWatcher 5 ай бұрын

The AI is probably rubber banding.

@SleepyBrady 5 ай бұрын

As a kid I always played with expert AI and usually was able to win. The only few mini games that were actually impossible were cherry go round and get the lead out. Actually impossible

@KinuTheDragon 11 ай бұрын

For the first one, might I suggest checking if the goomba is at least a minimum distance from any bombs?

@CodeNoodles 11 ай бұрын

I actually have that implemented already. It definitely helped!

@renakunisaki 11 ай бұрын

And prioritize gold.

@Laenthor 11 ай бұрын

@@CodeNoodlesYou could also straight up draw squares instead of circles so it would be nearly instant instead of having to call the function for each circle point?

@sarowie 11 ай бұрын

@@Laenthor did you watch the video? he has to use a polygon with a certain number of edges, as the game does otherwise ignore the shape. You can try to optimize the number of corners, but the advantage will be pretty small.

@Laenthor 11 ай бұрын

@@sarowie Oh I must've missed that part, it just seems to look for a closed shape.

@ArisTheMage 11 ай бұрын

As a programmer myself, it’s greatly appreciated you show the code. I hate when the KZfaqr at most shows a small snipit. Not to steal your code, but to see your logic :)

@MeneerEnMevrouwTrein 11 ай бұрын

05:30 I've never seen some collect so many goombas before! Too bad it picked up a bob-omb by accident because I would've loved to see how an even bigger goomba collection would've looked like.

@sarowie 11 ай бұрын

well, that sounds like a second channel video: AI plays minigames for an hour! I am not ironic, I mean that seriously.

@Makura6901 11 ай бұрын

Eyo trein kanaal nice

@kierrific1357 4 ай бұрын

I've never actually seen the Goomba section condense like that to fit more, it's a little weird.

@tornadowizard 11 ай бұрын

For the block one, you could have prewritten each shape, "square" "rect up" "rect right" etc so instead of writing out the coords for each map over and over you would just write which shapes get drawn in what order.

@CodeNoodles 11 ай бұрын

That's a good point!

@tornadowizard 11 ай бұрын

Thank you! I haven't used my coding skills in like 3 years unfortunately, glad to know I still have it!

@aaronconner1440 11 ай бұрын

This was AMAZING! Please automate more Mario Party minigames!

@whee2390 11 ай бұрын

Seconded, this was really interesting to watch

@carlyskolnik296 11 ай бұрын

Same as well I agree

@chipsleftwing 11 ай бұрын

WOOOOOOO MORE MARIO PARTY THATS WHAT I'VE BEEN WAITING FOR THAT'S WHAT IT'S ALL ABOUT

@0hellow797 11 ай бұрын

Yeah I’m with Chip on this one

@blackcat_064 11 ай бұрын

Some minigames I'd love to see you automate are Rail Riders, Cherry-go-round and Study Fall. These are some of my favourite minigames in Mario Party DS

@woobgamer5210 11 ай бұрын

Rail Riders and Cherry go Round should be is, cause Rail Riders is just, slide up from the bottom as quick as possible, and Cherry go round is, just continously draw circles as fast as you can. tbh i'd love to see Sprinkler Scailers done using melonds or no$gba by being a python script and python script vs 2 expert cpus

@GoldenAce17 11 ай бұрын

Getting a 00'00'00 on study fall is possible but SO hard! watching code do it every try would be awesome

@thewiseoldfox 11 ай бұрын

@@GoldenAce17I'm pretty sure everyone who grew up with Mario Party DS got 00'00 on Study Fall on accident, making the best unbeatable high score

@tacothedank 5 ай бұрын

@@thewiseoldfox I remember being able to do it intentionally without much difficulty. I'd be able to get it like 1 out of every, maybe, 5-8 tries?

@NekoEchoflower 11 ай бұрын

Man mario party ds was such a big part of my childhood. Only played with bots sadly, as none of my friends owned a ds, but it was still plenty fun Was glad to see a video about it, would love to see more automated games if possible :0

@romancatholicgameing 11 ай бұрын

Hard to believe that your last "image recognition" video was nearly a year ago already! Time flies fast, doesn't it?

@beeisland 11 ай бұрын

I'm glad my favorite mario party is getting some attention. Very fun seeing you destroy those infuriatingly perfect expert cpus. Good job and would LOVE to see more.

@CodeNoodles 11 ай бұрын

I know! Nintendo made the expert cpus WAY too difficult!

@carlyskolnik296 11 ай бұрын

Same 😊

@raptore.x 11 ай бұрын

@@CodeNoodles glad im not the only one who thought those expert cpus were just wayy too good, feels like theyre harder than other mario games sometimes lmao

@disdonut 11 ай бұрын

Code Noodles’s taste in music is amazing. I’ve been listening to The Noble Demon for a while because their arrangements are so good. They deserve lots of love for their work

@YeetoTheYeetafic 11 ай бұрын

CodeNoodles Friend: 'Yo I finally got 500 goombas without a bob-omb in goomba strangler from Mario Party DS!' CodeNoodles: 'I got more than humanly possible, I've already beat you'

@homerlol9058 11 ай бұрын

Loving these minigames automation

@Freddie_06 11 ай бұрын

9:45 "The best solution to a problem is usually the easiest one." - GLaDOS

@bongwater1856 11 ай бұрын

oh man, I loved playing this game as a kid. Loved watching it get destroyed, too! great work

@MoundN 11 ай бұрын

That vid was probably as far away from "destruction" as it could be. Its worse than human skill which in your faulty logic would mean literally every person winning against expert bots "destroys" the game like they are playing it in a way that was unintended...... Watch tas of mario party minigames, there you learn destruction.

@bongwater1856 11 ай бұрын

🤓

@MoundN 11 ай бұрын

@@bongwater1856 I know your comment kinda made you look like that but that's okay!

@Alex-gv9os 11 ай бұрын

Definitely want to see other automatization for Mario party minigame 🤩

@KLGB76 11 ай бұрын

Mario Party DS is my favorite Mario Party ever.

@leroyhak5081 11 ай бұрын

Oh man, I remember playing this on the ds. It was always a lot of fun to play against my siblings. And for everyone who thinks the expert ai is near impossible to win from, some games like the 2nd Trace Cadets and the 3rd Domino effect all depend on how fast and accurate you are.

@TheLobsterCopter5000 11 ай бұрын

Try the stargazing one next! Give the automator a challenge by having to compete with 3 expert CPUs at that game...

@doctorgrubious7725 11 ай бұрын

Personally I would’ve included a counter-draw around bombs that basically detects if a bomb is in the radius of a goomba, and if the circle it would draw around the bomb overlaps the goomba circle, to subtract the bomb’s circle from the goomba’s, For the second game I feel it’s like a cop out due to the fact it’s not really playing, it’s just doing it from a list that you made, you did a good chunk of the work, I would’ve gone with the black and white image and than have it instead just find the vertices of every shape and than add it to the shape array, so it creates the list on its own before drawing

@theAstarrr 11 ай бұрын

YO more nostalgia from probably my favorite videos of yours

@nitro5247 11 ай бұрын

It’s really cool to see how people my own age are using these tools on our childhood games. I also missed out on MPDS, but I did play NSMB when I was younger. These videos make me want to take on a project of my own, haha.

@x-x 11 ай бұрын

I enjoy your videos so much despite never playing these mini games and having no coding skills! You have a very calming and charming voice, so it's very interesting to hear and you don't try to downplay your skills at any point like many other KZfaqrs nowadays. Keep going!

@CodeNoodles 11 ай бұрын

Thanks, I'm glad you them!

@andym5280 8 ай бұрын

@@CodeNoodles I really them too! Especially the NSM videos!

@phantomgaming7544 11 ай бұрын

I played mario party ds a bit too much to know how long it would take just to unlock expert mode and then knowing how difficult it is to go against expert difficulty. Haven't played it in a while but I still have the game and haven't forgotten that I've spent way to much time on the game to have quite the collection and also every minigame unlocked naturally, plus actually being able to beat them quickly was another thing I've done, just never against expert. Appreciate seeing one of the most difficult ones get done faster than I could actively do myself

@unfortunatedisgrace246 11 ай бұрын

you have the perfect way of explaining so that most people understand without it being too complicated or too long winded! it's actually really entertaining!

@strawberrylemonadelioness 4 ай бұрын

I had this game as a kid and I still love it! It's still honestly my favorite Mario Party game.

@velvetbutterfly 5 ай бұрын

I would love to see you do a video explaining each piece of software you use so that people can get educated on the details to better follow what you're doing

@canadianlucario2643 11 ай бұрын

Would you try any other Mario party games with this? I’d love to see more of these videos, they help me a lot with learning what I can do with programming

@BromeoWuggles 11 ай бұрын

Love the Image Recognition videos

@ermamu 11 ай бұрын

I’d love to see more! Do you think ‘Hammer Chime’ would work?

@CodeNoodles 11 ай бұрын

Probably

@louisnemzer6801 11 ай бұрын

Playing video games: Fun Automating a computer to play games for you: More fun

@theAstarrr 11 ай бұрын

A suggestion to improve goomba wrangling - Check which way the goomba is going (and which way all bombs are going), based on the average time it takes to circle one, is it likely going to be near a bomb when circled? (maybe that would be easier if you had a program without delays) And I hope you automate all the skill based games in Marioparty DS, it's great fun watching your thinking and programs.

@love_a_hater 10 ай бұрын

This game was my favorite, and seeing that beautifully written code is so satisfying.

@Imaproshaman7 11 ай бұрын

This was really cool! I'd love to see more of these. The original Using Image Recognition To Find Mario video is how I found out about this channel in the first place. Oh yeah, I'd be interested to see if it would be possible to automate the minigames that require the mic.

@silverstorm323 4 ай бұрын

I would love to see more minigames coded. These were fun to watch. Maybe even other MP games in the future?

@piboiindahouse5169 11 ай бұрын

My guy's got a sponsor! Good job, you deserve it.

@GhostlyOrSomething 11 ай бұрын

I love this! It's always amazing watching how all this works. I personally find it really entertaining and would like to see more.

@kierrific1357 4 ай бұрын

Im glad some people remember this game at least.

@ShadowBulb 11 ай бұрын

Hope ur having a good day!

@CodeNoodles 11 ай бұрын

Thank you, I am!

@ShadowBulb 11 ай бұрын

@@CodeNoodles I want to learn how do this stuff so I can auto do tasks at school that are digital! I also find it so cool that you just see a task and have the ability to automate it!

@MegaKBang 11 ай бұрын

Terrifying how close the expert cpu is to beating an almost perfect AI

@Noah-tn5bc 11 ай бұрын

This was such a good idea for a game to automate! i alwyas find it fascinating when we can make AI that is better than the in-game one. Would love to see more minigames automated. This was one of my favorite games as a kid ❤️

@mememkyu 11 ай бұрын

I need more of this! This type of stuff is so cool to me

@htspencer9084 11 ай бұрын

Awesome vid! Unsolicited suggestion for the first one: Maybe comparing the location of the chosen goomba over two frames to determine it's movement vector and use that plus knowing how long your circle takes to draw (assuming it's a constant time), means you can draw ahead of the goomba and get it perfectly centered. You could even then track the movement of bombs within a certain range of that goomba and know ahead of time if the circle would pick up any bombs so you can avoid that goomba. Is any of this multithreaded? Would be curious to see how much of this could be put on worker threads. The drawback to my suggestion is when they bounce off the wall, as you'll need to figure out their reflections which sounds like effort but you could probably just ignore it as its only an edge case (pun very much intended).

@CodeNoodles 11 ай бұрын

None of this is multithreaded. All of your suggestions are fantastic, but they would be nearly impossible to implement.

@LevelUpGA 11 ай бұрын

Next time you can try all bloons TD with genetic algorithm, theoretically you need only string recognition and tower positions/hotkeys and clicking on the map and good luck with training, I try random clicking and I win BTD1 in 2/4 times with random clicking (generation 0) without upgrades but not with full hp

@johnsimpsen5 11 ай бұрын

YES!! I love Mario party ds!!! Definitely the best Mario party!!! Please do this game again!

@vaporcranberries 11 ай бұрын

I want to see more of this. This was so entertaining

@akamai8097 11 ай бұрын

I'd like to see more mario party minigames, but I'd love it if you did an episode on a warioware game!

@fernando98322 11 ай бұрын

For Trace Cadets, I'm sure you can automate further by tracing the blue lines (really, they're line segments with a set number of directions to take) for adjacent figures but that might take too much processing time that the Expert CPU might beat you at that point

@tekayo63 11 ай бұрын

this is so cool! since these were all duel (or at least the duel versions of) minigames, i think in a potential next video it could be cool to see some ffa or 2v2 games like hot shots or sprinkler scalers

@TalkySteak 11 ай бұрын

I was stoked to see another minigame automation video hit my feed. Love this series! Thanks!

@CodeNoodles 11 ай бұрын

Thanks, I'm glad you like it!

@TalkySteak 11 ай бұрын

@@CodeNoodles Do you push your code from these videos to a Github repo by chance?

@pokeli2728 11 ай бұрын

I love these videos! Please make more like this!

@ItsIdaho 4 ай бұрын

One of the best DS games ever. Miss our 2 vs 2 sessions😢

@krankenwagen6042 11 ай бұрын

this is the sequel we didnt deserve but the sequel we got

@realElzie 11 ай бұрын

I’d love to see some more videos on automating Mario party games. I’ve got to design and make my own program for a Python final project for a college class and I might do something like this, not sure yet though…

@Neoh53 11 ай бұрын

For the first mini game (circle goomba) i know from my childhood that you can draw pretty small circle on the goomba. Reduce the size of the circle to decrease the risk of catching a goomba

@DagoDuck 11 ай бұрын

If there‘s one thing I‘d really like to see, it‘s optimizing these scripts to near perfection. For example the first minigame if it wasn‘t for that bomb, it would‘ve had so many Goombas, the game had to squish them together.

@derpylemon852 11 ай бұрын

Automate Study Fall pls! I remember getting a high score of 0.00cm by pressing it exactly when I needed to!

@Mickelraven 11 ай бұрын

This was great! I would love to see you automate more Mario Party DS mini-games. Part 2 please?

@__--_--_----- 11 ай бұрын

I love automating, done some work with pyautogui myself to autowin the wordle battle royale game lol. great vid, would love to see more of these

@noahvasiliauskas233 11 ай бұрын

More mini games pls I love listening to these 😊

@chikanojo 11 ай бұрын

these are awesome! id love to see more!

@b_megamaths 11 ай бұрын

It's good to know that, no matter how advanced code has become, I'm still able to beat it handily at Domino Effect.

@ironici 11 ай бұрын

I swear this is the only way to beat Trace Cadets

@cravonomire9971 11 ай бұрын

It is funny how nostalgic I get for this game.

@TheMamaluigi300 5 ай бұрын

Maybe for Goomba Wrangler, the program could probably compare the latest screenshot with the previous one to gauge its target’s speed so it can predict where the goomba will be when the circle completes

@jordancrouse714 5 ай бұрын

These are the best. Its so cool what you can do. I dont understand it but im going to watch it 🤣

@itsybutsy 5 ай бұрын

When you realize he was literally just making another COM for these mario party minigames and then he pit them against the pre-existing COMs for these mario party minigames

@Zyiah 11 ай бұрын

i love these sorts of things

@rainbowcat498 7 ай бұрын

The sweer nostalgia i got from watching this!!!

@justarandomwoof2247 11 ай бұрын

Would be cool to see more!

@Puddincess 11 ай бұрын

I'd definitely like to see more of these. If I could choose minigames to try, I'd say Hedge Honcho (ladybugs and wasps can be predicted by the leaf before them, and Im curious to see if you can make it image recognize that or how well you can make it rub the ladybug), the skydiving minigame, and the boo-spotting 1v3 I forget the names of 😔

@batofdestiny7801 5 ай бұрын

I love videos like this. I’m not very smart with computers and technology but this shit is super cool

@777omen 10 ай бұрын

I want to see Image Recognition dominate all of the Mario Party DS bosses.

@bloodwolf2002 10 ай бұрын

That'd be so cool if possible

@777omen 10 ай бұрын

For Hammer Bro it's easy but for the others, I don't know how you would find a way to implement the image recognition.

@bloodwolf2002 10 ай бұрын

@777omen dry bones "might" be easy out of the remaining bosses but don't know

@lightgodyt. 9 ай бұрын

It would honestly be amazing if you do more minigames!

@Jagpagaco 11 ай бұрын

code noodles video lets gooo !

@SinisterPixel 5 ай бұрын

For Domino Effect, I feel like it might be helpful to just read the upcoming input instead of the current one. The window to press the input comes up REALLY early so you could basically prebuffer the entire thing and smoke the CPU.

@Vextrove 11 ай бұрын

I would like to see more minigames!

@benshattock4945 11 ай бұрын

For the second one you could have done some image processing on the shapes, using something like a Lapacian filter for edge detection, with the correct thresholding this would give you a black and white image (with the white part of the image being the shapes you need to draw). This can also be computed very quickly if you did the calculations in the Fourier space. This can be done with Modules like OpenCV-python. :)

@__--_--_----- 11 ай бұрын

would be nice to see it taken to the next level to automate a more complex game, I think that is more impressive than doing a few simpler games

@nathanlamberth7631 11 ай бұрын

Those second two were too close for comfort

@AzidDrop 11 ай бұрын

I hope there will be another one of these videos 😊

@daskampffredchen9242 11 ай бұрын

I would love to see more

@XenoPon2 11 ай бұрын

The best Mario party ever made.

@pablojp3498 11 ай бұрын

Loved the vid

@rifatbobos 11 ай бұрын

"You know what? Fck you" **becomes an even more Expert CPU*

@bupp291 11 ай бұрын

These are so fun! I'm actually taking a lot of inspiration from these videos for my final project in my Master's degree for Biomedical Engineering. It involves automating a precise specimen sampling mechanism using image recognition, deep learning, and pyautogui. Thanks for the tips! 😃

@CodeNoodles 11 ай бұрын

That sounds amazing! Good luck!

@bupp291 11 ай бұрын

@@CodeNoodles Thank you! I'll let you know how it goes 😃

@David_Rg 11 ай бұрын

dude, when I was a kid I hated soooo much the block one 😂 I still struggle with it, ngl

@uberlord983 10 ай бұрын

Hear me out, I have an idea: Write automated code for every mini-game in Mario Party DS, as WELL as custom Party Board AI. Then, bundle all of it together as a custom mod pack that replaces the actual AI with your code, so its essentially like playing against a bunch of copies of you.

@Leekodot15 11 ай бұрын

I think you were on to something with the scrapped solution for detecting the grid. But you needed to look for the shapes in a blue outline afterwards. THEN you could automate the shapes.

@uniderpx3452 11 ай бұрын

hell yeah we love pyautogui

@Silv3rM4st3r 11 ай бұрын

I would love to see more.

@AlphaPizzadog 4 ай бұрын

If you wanted to improve the goomba catch game, you could try making ovals instead of circles, as well as decreasing the size the reduce chances of the AI accidentally picking up bobombs

@p6t158 11 ай бұрын

One of my favorite games

@CoffeeAddictEvan 11 ай бұрын

I think if you use what's called the midpoint circle algorithm to draw your circles, instead of generating a polygon and then drawing it, you should be able to grab goombas much faster