No video

Vision Recognition & Other Robot Interfaces

  Рет қаралды 61,242

James Bruton

James Bruton

Күн бұрын

Пікірлер: 177
@pdeboer1987
@pdeboer1987 4 жыл бұрын
"It should detect anything that looks like a face." Holds up severed head.
@SCU3A_S7EVE
@SCU3A_S7EVE 4 жыл бұрын
In the next video the robot becomes sentient and starts wearing James’ face as a mask to blend in with the other normal hue-mans.
@frac
@frac 4 жыл бұрын
@@SCU3A_S7EVE That's a quest in Borderlands: borderlands.fandom.com/wiki/A_Real_Boy:_Face_Time
@sawyer7973
@sawyer7973 4 жыл бұрын
How in God's name can one person get so much done so quickly
@the_biggest_chungus7508
@the_biggest_chungus7508 3 жыл бұрын
Cocaine's one hell of a drug apparently
@garagemonkeysan
@garagemonkeysan 4 жыл бұрын
Wow. That's some killa engineering. Mahalo for sharing. : )
@InspireToMake
@InspireToMake 4 жыл бұрын
This is tremendous amount of work!!! You make it look so easy.
@pobbrett3244
@pobbrett3244 4 жыл бұрын
Could you add a kinect to this system and mirror the moves of a person in front of it ? If so it could be handy to record a pro dancers moves to the robots
@Denndor
@Denndor 4 жыл бұрын
If Omega can get the Single Bone positions of a kinect, then it should be possible. As long as you can get a Kinect 😁
@trentshimek5747
@trentshimek5747 4 жыл бұрын
Great idea, I have been wanting to do that myself. I once saw a Kinect sensor for like 40 American dollars!
@pobbrett3244
@pobbrett3244 4 жыл бұрын
Trent Shimek I’m in the uk and looked in a preowned shop here called cex and they had 4 kinects none had the power cable but they were only £3.50 (about $4) I’m sure the cables could be had on eBay for a couple £’s/$’s
@trentshimek5747
@trentshimek5747 4 жыл бұрын
@@pobbrett3244 Nice, thanks for the information!
@plemli
@plemli 4 жыл бұрын
Well done ! The software/sensor integration is solid and very interesting and the robot moves fluently with confidence and without jitters. Now your next mission James, should you accept it, is to build a highly dynamic and energetic robot that can perform extremely jerky yet fully controlled movements like a professional dancer can. A whole new power and force level which is a big challenge from a mechanical and electronics standpoint.
@OzAndyify
@OzAndyify 4 жыл бұрын
Have you seen the latest from Boston Dynamics? More athletic than most humans, but I bet it costs hundreds of times more than this one from James. He is doing pretty darn well with his budget and tech!
@pragon1173
@pragon1173 4 жыл бұрын
This movement is so smooth! Great job James
@reggiep75
@reggiep75 4 жыл бұрын
11:30 - I'd most definitely have it track the middle finger as you so know kids will stick the finger up at it! James, you really are a highly skilled super nerd, most definitely meant in the most respectful way too, and your projects are always great and this project with its accessibility and interaction by the public will be a big one!
@sharedinventions
@sharedinventions 4 жыл бұрын
I can easily imagine for this robot, to perform sign language messages, and also hand sign of solmization (used in Kodály method for music education). Even conducting an orchestra.
@sharedinventions
@sharedinventions 4 жыл бұрын
Eye movement along with head movement would be spectacular.
@kissingfrogs
@kissingfrogs 4 жыл бұрын
Very impressive. The movements are so life like I was wondering if it could mimic a human doing the robot
@OzAndyify
@OzAndyify 4 жыл бұрын
Excellent stuff James! You need a vertical axis on the stand so it can bop up and down to the beat. I reckon shops would pay for a mannequin that looks at passing customers and poses for them.
@jamesbruton
@jamesbruton 4 жыл бұрын
I will build a mobile base at some point - considering a lifter!
@spikekent
@spikekent 4 жыл бұрын
I definitely want to come and see your shows.
@EDP1
@EDP1 4 жыл бұрын
james you are a genius.thanks for making these video's greetings from belgium.
@douglasmaclean5836
@douglasmaclean5836 4 жыл бұрын
the video ive been waiting for openCV ! Wooo Hooo !!!... Thanks James !!
@funy0n583
@funy0n583 4 жыл бұрын
i've never been this early to an upload from you
@funy0n583
@funy0n583 4 жыл бұрын
@Vichekesho mix Tanzania okay
@iamnotarobot35
@iamnotarobot35 4 жыл бұрын
well done james a lot of work and research went into this . mad respect
@bas10oli4
@bas10oli4 4 жыл бұрын
This movement let's me think about those old animated Minecraft videos 🤔😂
@StePhanMckillen
@StePhanMckillen 4 жыл бұрын
10 out 10 bro well put together
@ClownWrldUSA
@ClownWrldUSA 4 жыл бұрын
How well can the robot dance like a robot? Also, I love these videos, I hope one day that robot gets to walk, it amazing watching you do this.
@fynbo1007
@fynbo1007 4 жыл бұрын
Awesome, very interesting and cool, thank you for sharing your amazing journey. God bless you and your family
@jamesbruton
@jamesbruton 4 жыл бұрын
thanks!
@djrensvandeburgt1236
@djrensvandeburgt1236 4 жыл бұрын
I use qlc+ for light shows but this is pretty nice
@StarScapesOG
@StarScapesOG 4 жыл бұрын
I'll be honest, I'm not a huge fan of the mouths.... But what you're doing here is awesome! It's such a clever idea to use DMX for thecontrols! Keep up the great work!
@FailsafeFPV
@FailsafeFPV 4 жыл бұрын
QLC+ IS AMAZING SOFTWARE
@Ricardo-zk9js
@Ricardo-zk9js 4 жыл бұрын
This is insane !!!! Who else get hype
@mossm717
@mossm717 4 жыл бұрын
On the matrix of buttons, you could light up a pixelated image of the robot, and pressing the button on each joint location moves that joint.
@gistnoesis9116
@gistnoesis9116 4 жыл бұрын
Cool robots ! You should have the camera on the face of the robot so the image change as the robot face rotates. It transform tracking into a close loop control, making the robot eye stance a lot more credible. Instead of writing you animations by hand, it would be cool to import them from human pose. This way you can take some dancing video, run a pose extraction, and have the robot do the pose to be automatically in sync with the music. Syncing movement direction change to the music beat will greatly improve their liveliness (maybe with a sharper interpolation function and higher accelerations) .
@WATCHER4FREE
@WATCHER4FREE 4 жыл бұрын
Once you get the hands attached, You should integrate this into your robot dog. Not like a centaur (too front-heavy) but more like the robot from the film, Kill Command.
@iamgrays
@iamgrays 4 жыл бұрын
What about mimicing peoples upper body and head movement with Kinetic or some other camera? Also the robots may need to move a little quicker if possible? Great work though.
@lukedavid8099
@lukedavid8099 4 жыл бұрын
I'm sure they can move faster I think they are running at this speed because the motion smoothing is more efficient? Not sure just a guess
@cerberes
@cerberes 4 жыл бұрын
And soon the Cylons will end all human life on earth... good job James!
@iamnotarobot35
@iamnotarobot35 4 жыл бұрын
i love the battlestar galatica led visor
@Keksstar
@Keksstar 4 жыл бұрын
Now you should add some cosmetic panels to make them look even more cool :)
@richardlincoln886
@richardlincoln886 4 жыл бұрын
Colab with Big Clive - somehow this should turn up in the Edinburgh Tattoo! - even if just to automate back of house
@dynorat12
@dynorat12 4 жыл бұрын
Looking really good James's
@froggytrampster784
@froggytrampster784 4 жыл бұрын
Bruton's dynamite duo!!! :)
@Jack-It-UP
@Jack-It-UP 4 жыл бұрын
Your in the zone,was there once with a motoman
@oliverdowning1543
@oliverdowning1543 4 жыл бұрын
If you have a webcam on it and you add hands as you say you could have some stationary vr game from the robots first person view that actually controls the robot. You may need pressure sensors so it doesn’t break itself though, that’d be a good safety measure anyway so it could be good to add regardless.
@RobertKvsv
@RobertKvsv 4 жыл бұрын
James Bruton = cool 100
@TacoMaster3211
@TacoMaster3211 4 жыл бұрын
You should add some RGB light strips along the shoulder cable harnesses. That way you can colour match them with any cosmetics you put on, as well as make them controllable with the DMX software.
@PhG1961
@PhG1961 4 жыл бұрын
Wonderfull, indeed very smooth movement, which I really like. Now let it talk ! Details on the servo's used in the neck/head ?
@theoleana
@theoleana 4 жыл бұрын
Omg they’re so smooth
@vectorrobot8092
@vectorrobot8092 4 жыл бұрын
Amazing work I love these robots
@adrianshawuk
@adrianshawuk 4 жыл бұрын
Awesome stuff 👏👍
@Sharklops
@Sharklops 4 жыл бұрын
I really hope when these are ready for prime time you can get together and jam with ​ *LOOK MUM NO COMPUTER ​(BUT SOMETIMES A COMPUTER)*
@Gaming-Archives
@Gaming-Archives 4 жыл бұрын
When you were building Ultron you put in a system where you touch his shoulder he would turn his head that way. Are you going to do that with this robot
@rollbacktiun1426
@rollbacktiun1426 4 жыл бұрын
That is a big ass metal robot you don't want anyone near that thing while it's moving . Especially if he plans to have kids play with it
@RobertKvsv
@RobertKvsv 4 жыл бұрын
Future confirmed
@bruceneely4859
@bruceneely4859 5 жыл бұрын
I like the face tracking. that would be quite handy for many functions, to bad it takes 4 pieces of software to do it. you could probably do a fairly quick redesign to add the camera into the head.
@jamesbruton
@jamesbruton 4 жыл бұрын
MyRobotLab can talk straight to an Arduino and control i/o pins and servos directly.
@andycrask3531
@andycrask3531 4 жыл бұрын
@@user-wi8lw7nq5g Supporters get videos earlier 😉
@bruceneely4859
@bruceneely4859 4 жыл бұрын
@@user-wi8lw7nq5g patreon superpowers, I highly recommend them for channels you want to support
@Gaming-Archives
@Gaming-Archives 4 жыл бұрын
Where do you buy andino's
@apbosh1
@apbosh1 4 жыл бұрын
You must have had a Frankenstein moment when it tracked your face
@Vaxtin
@Vaxtin 4 жыл бұрын
Pretty neat show demonstration. The thing is though, not that they have 'faces' I've been pretending it's freaking out that it doesnt have and 'hands' yet and it flails about.
@TheProjectOverload
@TheProjectOverload 4 жыл бұрын
James creates his own terminator - on the next episode, adding flamethrowers and programming to take over the world!!
@MisterMakerNL
@MisterMakerNL 4 жыл бұрын
Mind blown!
@KrantzThe
@KrantzThe 4 жыл бұрын
Really awesome!
@hfe1833
@hfe1833 4 жыл бұрын
Pretty impressive, worthy of subscribing
@dafoex
@dafoex 4 жыл бұрын
That eye panel could probably be used to display text, so you could maybe have the public tweet a hashtag to have their name shouted out, e.g. you could tweet "#dancingrobot" and the eyes would scroll across "James rocks!". You'd have to plug it into a database of real names so it rejects people setting their name to "bums", and probably strip out emoji, too, but it'd be pretty cool to have your name shouted out by a robot.
@dafoex
@dafoex 4 жыл бұрын
Depending on how in depth you wanted to go, you could also read the bios of people to get some idea of what they like. I say this because a "real name filter" would exclude a lot of people with legitimate pseudonyms, so if your system could read, say, a furry's bio and work out that they are a fox that likes pizza, the robot could simply say "Pizza fox rocks" instead of whatever hard to pronounce name they've given themselves.
@PKMartin
@PKMartin 4 жыл бұрын
15:30 you have built a robot which can dab... this is the future
@DoRC
@DoRC 4 жыл бұрын
I wonder if the mouth would look better if the lights started from the middle and went both up and down as opposed to starting at the bottom and going up.
@jamesbruton
@jamesbruton 4 жыл бұрын
Maybe, it would give it a different character
@nikoha1763
@nikoha1763 4 жыл бұрын
13:28 who is standing in the background?
@ShaunHusain
@ShaunHusain 4 жыл бұрын
It's a 2D stand up cut out of him
@onebeartoe
@onebeartoe 4 жыл бұрын
This is awesome!
@thepvzgardenwarfare
@thepvzgardenwarfare 4 жыл бұрын
You can also use easy stand alone 2 to control the dmx ^^
@TheSaheasy
@TheSaheasy 4 жыл бұрын
I mean, since you are already using OpenCv, you can add OpenPose for full body feedback.
@sidneyking11
@sidneyking11 4 жыл бұрын
Dude, you are awesome.
@victorajuobi8590
@victorajuobi8590 4 жыл бұрын
Your an amazing engineer
@KyleeYay
@KyleeYay 4 жыл бұрын
You *could* recreate the shadow fight scene from Real Steel :ooo
@nadiamayer7559
@nadiamayer7559 4 жыл бұрын
yes
@Hiewiedoeseverything
@Hiewiedoeseverything 4 жыл бұрын
I love your channel !!
@zenithparsec
@zenithparsec 4 жыл бұрын
You know, GPLv3 doesn't mean someone using clones of your robots commercially are required to publish any changes they made. The only time they're required to do that is if they "convey" the robots to another party... e.g. sell or give them away. If they keep control of the derived systems, they don't have to give anything to anyone, even if they use the robots commercially, displaying them in public. To “propagate” a work means to do anything with it that, without permission, would make you directly or secondarily liable for infringement under applicable copyright law, except executing it on a computer or modifying a private copy. Propagation includes copying, distribution (with or without modification), making available to the public, and in some countries other activities as well. To “convey” a work means any kind of propagation that enables other parties to make or receive copies. Mere interaction with a user through a computer network, with no transfer of a copy, is not conveying. The GPLv3 covers rights and obligations of those who propagate and convey the covered works. If you're not propagating it, you're not a required to distribute any changes you've made. Otherwise everyone company which used mysql and modified the config would have to make it available to anyone who used the database... but that clearly isn't the case, nor the intent. You only have to provide the source code (and build instructions) if you provide the "object code". It's not my favorite license. The GPL takes away your freedom to choose to be selfish. Isn't the freedom of choice also a freedom? The BSD licenses are more free -- you basically just have to say "Parts of this were written by XYZ, but I changed some of it... don't blame XYZ if it's broken." Public domain code is completely free - the "license" just says "do what you want, but don't blame me."
@Sharklops
@Sharklops 4 жыл бұрын
You need KITT's three-bar voice animation for the mouth when the eyes are doing the scanner animation
@ZombieB
@ZombieB 4 жыл бұрын
Este proyecto está fenomenal, me encanta.-
@TiagoTiagoT
@TiagoTiagoT 4 жыл бұрын
Maybe you could use some computer-vision and a webcam and have people control the robots with their bodies? (or perhaps if you don't have to worry about the show environment messing up the IR, use something like a kinect)
@gmannz1981
@gmannz1981 4 жыл бұрын
Stunning!!
@jamesbruton
@jamesbruton 4 жыл бұрын
thanks!
@djjuan518
@djjuan518 4 жыл бұрын
congratulations!!! genius
@MagivaIT
@MagivaIT 4 жыл бұрын
great, just great !!
@BartJBols
@BartJBols 4 жыл бұрын
The head needs a camera with face tracking, then make the head have a "look at people looking at him/her/it"
@heinzpeter8264
@heinzpeter8264 4 жыл бұрын
Did you even watch the video
@Gaming-Archives
@Gaming-Archives 4 жыл бұрын
That's literally what he did in this video
@OzAndyify
@OzAndyify 4 жыл бұрын
Yes, by putting it in the head rather than fixed on the shoulder it could turn the head to keep the person in the frame for longer and track them across the room. I'm sure he will do that.
@tomburris8380
@tomburris8380 4 жыл бұрын
Yeah, it would be cool to distinguish between just a face and actually knowing when someone is looking at the robot.
@CrashDy
@CrashDy 4 жыл бұрын
Would be awesome if you got a 180 degree camera for it.
@infinite-in-one3451
@infinite-in-one3451 4 жыл бұрын
Super cool
@chikato7106
@chikato7106 4 жыл бұрын
single handedly lapped Creative Engineering and The Rockafire Explosion by having such a modern implementation.
@thomzz3449
@thomzz3449 4 жыл бұрын
With its range of motion could it actually dab? Maybe the shoulder can't reach high enough
@eldhokurian8940
@eldhokurian8940 4 жыл бұрын
That's amazing
@evulatas
@evulatas 4 жыл бұрын
Hey James, I really like your video especially because of your ideas how it could be possible to control the robots, I have another Idea maybe you could make a suit or exoskeleton that records the movement of a human, or something @Pob brett mentioned.
@BlogVomMax
@BlogVomMax 4 жыл бұрын
Blue and yellow?... Bumblebee and optimus?
@kirilchi
@kirilchi 4 жыл бұрын
Just WOW
@rafcins
@rafcins 4 жыл бұрын
Nice
@carlvanheezik263
@carlvanheezik263 4 жыл бұрын
Thumbs up
@Karlemilstorm
@Karlemilstorm 4 жыл бұрын
Do you have some software that ensures that the arms won't crash into each other?
@jimdunleavypiano
@jimdunleavypiano 4 жыл бұрын
Robots are looking great, but have you thought about collaborating with a choreographer? At the moment that robot dances like me after 6 pints.
@jamesbruton
@jamesbruton 4 жыл бұрын
Some of that is down to power draw if it moves faster!
@vollpfosten5249
@vollpfosten5249 4 жыл бұрын
Whats that song he did the dmx rgb example with?
@vollpfosten5249
@vollpfosten5249 4 жыл бұрын
At 2:50
@TheMixmastamike1000
@TheMixmastamike1000 4 жыл бұрын
did you make Chapie?
@marobugvanyen8737
@marobugvanyen8737 4 жыл бұрын
you are my idol
@Robothut
@Robothut 4 жыл бұрын
Is that the MAX speed you can get out of the motors ? I thought earlier you had said that you were running at a lower voltage and had room to bump it up. Great looking show robot. Thank you for sharing.
@evanflynn1738
@evanflynn1738 4 жыл бұрын
Seems like a great project to use Robotic Operatijg System (ROS) for! Have you looked into using it maybe with it's Arduino plugin library?
@davidwilkinson8431
@davidwilkinson8431 4 жыл бұрын
Can you make it recognize when some one tries to shake hands. And have it shake hands with them. Or even stick it's hand out when it looks at a face.
@Dark_Intentions
@Dark_Intentions 4 жыл бұрын
You should hook it up to a oculus quest so you can control the head and it would be portable
@bruceneely4859
@bruceneely4859 4 жыл бұрын
that's a pretty cool idea
@StevenMartinGuitar
@StevenMartinGuitar 4 жыл бұрын
Pretty nimble! Can we turn this one into a breakfast making robot too?
@daraphek7411
@daraphek7411 4 жыл бұрын
It very cool
@Martin-4D
@Martin-4D 4 жыл бұрын
totally EPIC!
@gkess7106
@gkess7106 3 жыл бұрын
Vision recognition 11:24.
@channacharls5162
@channacharls5162 4 жыл бұрын
where can i get the python script to the opencv and osc or can you put the code
@johnkoester7795
@johnkoester7795 4 жыл бұрын
How can I get my robot to recognize me as her creator?
@MrMuzza008
@MrMuzza008 4 жыл бұрын
By your command....
@alihssain9264
@alihssain9264 4 жыл бұрын
Sir, is it Arduino control robot or raspberry pi ?
@Eternal_-sg2tj
@Eternal_-sg2tj 3 жыл бұрын
I was brought here from thy module.
Autonomous NERF Robot controlled by LIDAR
20:58
James Bruton
Рет қаралды 184 М.
High precision speed reducer using rope
20:19
Aaed Musa
Рет қаралды 1,6 МЛН
а ты любишь париться?
00:41
KATYA KLON LIFE
Рет қаралды 3,5 МЛН
Кадр сыртындағы қызықтар | Келінжан
00:16
Alternative to bearings for tiny robots
12:05
Breaking Taps
Рет қаралды 671 М.
World's First SCREW-BIKE
23:04
James Bruton
Рет қаралды 2,2 МЛН
Robot Dances so You Don't Have To
12:05
James Bruton
Рет қаралды 114 М.
SOLVING the Mystery Behind a Soviet Spy Bug : A True Masterpiece of Technical Elegance!
31:37
Will this toy engine work at full size? (yes)
15:35
Steve Mould
Рет қаралды 5 МЛН
We Built a Camera with an Etch-a-Sketch
30:53
Every Flavor of Robot
Рет қаралды 646 М.
I found a use for the Mobius Strip Tank
16:35
James Bruton
Рет қаралды 314 М.
I took Taser Chess to Open Sauce
12:40
Everything Is Hacked
Рет қаралды 353 М.
Can Reaction Wheels control a Drone?
24:32
Tom Stanton
Рет қаралды 2,4 МЛН
Mechanically Stable Monowheel
13:06
James Bruton
Рет қаралды 307 М.
а ты любишь париться?
00:41
KATYA KLON LIFE
Рет қаралды 3,5 МЛН