14 күн бұрын
14 күн бұрын
21 күн бұрын
28 күн бұрын
Ай бұрын
Ай бұрын
Ай бұрын
2 ай бұрын
2 ай бұрын
2 ай бұрын
2 ай бұрын
2 ай бұрын
Пікірлер
@timwallis-du6xg Күн бұрын
I have been eager to do this project with my son this summer. I hope the next video comes soon :-)
@LarrysWorkbench Күн бұрын
Thank you so much - that's absolutely great to hear! This whole project was originally designed to be kid-friendly, although it seems like it evolved a little bit. I don't make any money doing this, but comments like yours make it absolutely worthwhile. I've posted my source code at github.com/larrysworkbench. Keep in touch and let me know how your project goes!
@timwallis-du6xg Күн бұрын
Thanks very much! I always look forward to your next video
@LarrysWorkbench Күн бұрын
Fantastic! I'm trying to post about one a week. Let me know what you'd like to see in particular
@massedin Күн бұрын
Hey there, suuper cool ideia!! I´m from Brazil and some years ago me and my father worked on an project where we created a bluetooth controled car using Arduino, it kinda look like yours. Your video gave us some ideas, we will try something like your project. Thanks for the videos, keep going!
@LarrysWorkbench Күн бұрын
That's great! Let me know how your project goes -
@michalpawilcz4063 2 күн бұрын
Hello, I have an Adeept RaspClaws robot. I'm trying to make an interactive hexapod but the gpt chat tries to move but nothing moves. Can you share the commands.json structure of the file?
@LarrysWorkbench 2 күн бұрын
I don’t know the exact JSON structure but the OpenAI API docs are pretty good and I’ve posted a version of my Python code at github.com/LarrysWorkbench
@sourabhpandey2004 2 күн бұрын
Floyd got rizz Really fascinating !!
@LarrysWorkbench 2 күн бұрын
He does for sure -
@Dufftata 3 күн бұрын
cable management looks good actually tho ;D I see your mic solution, I am still working on my overly-complicated onboard mic solution
@LarrysWorkbench 2 күн бұрын
@Dufftata yeah it was cheap from Adafruit.com but Idk what the shipping would be. The *only* problem I have with the Whisper API transcription is if I try speaking from more than 4-5 feet distance (lol 1.5 meters). So I'm also considering upgrading, but I'd want it to be USB plug-and-play, which this one was
@LarrysWorkbench Күн бұрын
@Duftata By the way - feel free to amplify the project to your subscribers if you want ;)
@jamesmoon5632 3 күн бұрын
Wow great video love where this is going
@LarrysWorkbench 2 күн бұрын
Thanks so much! The project is defenitely gaining some momentum -
@HelamanGile 10 күн бұрын
interesting
@LarrysWorkbench 10 күн бұрын
Thank you.. check out some of Floyd’s other videos
@ShivamMallick-kq7bd 10 күн бұрын
How can i contact you? For some doubts
@LarrysWorkbench 10 күн бұрын
Thanks for reaching out. The easiest way is to leave me messages here -
@jamesmoon5632 11 күн бұрын
Love the videos man wanna make my own talking robot.
@LarrysWorkbench 11 күн бұрын
Go for it (!)
@Dufftata 11 күн бұрын
thank you for inspiring! I've noticed that "personality" thing is really key to make the conversation entertaining (none-flat). Don't have that polishes just yet, maybe how to use different modes? Don't have a good idea how to build this so that is it easy to navigate for the user. I've connected a power-bank to the raspberry pi now, to make the thing portable, and it seems to run for quite a while (however it is just the speech stuff, no motors just yet). I still have to work on the transcription precision, cause I noticed that what I am saying and what gpt4o receives as a text can differ too often by too much. Love your stuff!!!! Waiting for the next video(s)!
@LarrysWorkbench 11 күн бұрын
@Dufftata Thx so much for the support! I just posted my code on Github / LarrysWorkbench feel free to check it out. It seems like "Personality" is what turns GPT into "Floyd" and makes the project fun. Floyd's Personality comes from about 12 plaintext sentences. I think of it as his Long-Term Memory. The most important instruction is for him to keep his responses BRIEF, two sentences max. Regarding transcription - maybe check out your hardware. I feel like the Whisper API does a really good job when I give it a decent audio file to work with....
@bramvanweelderen9233 12 күн бұрын
Heyy Where van I find how to do this do you have Any other social media
@LarrysWorkbench 11 күн бұрын
Check out my series of video tutorials on KZfaq where I'm basically going through the entire project week by week. I don't have any other accounts, but considering posting the code on Github
@sourabhpandey2004 15 күн бұрын
Indian Student here great work man really really liked it !! for your work your earned a sub there ;)
@LarrysWorkbench 15 күн бұрын
Thanks so much! More videos coming
@Dufftata 16 күн бұрын
good morning Larry, got my early morning coffee ready, and your upload timing is perfect, cause I am literally setting next to my "robot", (first ever raspberry pi experience also), have the vnc set up, and next need to solve the python part (I am a programmer, so debugging it should be easy (famous last words), however I hope to have gpt4o do the full thing, rather than also using eg elevenlabs to get the voice going, gonna watch your video now! Thanks for doing this, very fun
@LarrysWorkbench 15 күн бұрын
That’s awesome! Thonny came already installed on my Raspberry Pi but I think you can use Visual Studio Code as an option. I did struggle a little bit to get the “Board” library installed. It accesses memory and the GPIO pins so I have to run it as super user. Next week I’ll post our first API call to OpenAI. Floyd’s code is actually three different ones (transcription, chat, and text-to-speech), with sound effects to distract from the latency. Have fun!
@DividedWeFall 17 күн бұрын
Would you consider asking it viewer questions?
@LarrysWorkbench 17 күн бұрын
@DividedWeFall Absolutely! What would you suggest?
@dmeadutube 17 күн бұрын
I like this
@LarrysWorkbench 17 күн бұрын
Thank you! It's been a wild project.....
@AngeloXification 17 күн бұрын
Weapons grade zingers
@LarrysWorkbench 17 күн бұрын
Yeah he's definitely got a personality. I'm posting more videos all the time.....
@borstenpinsel 18 күн бұрын
I envy the robot. It can underline it's discontent with sound effects❤
@LarrysWorkbench 17 күн бұрын
Lol that's great. We should all do the same thing -
@zoeyzhang9866 19 күн бұрын
Nice build! If any upgrade version in your pipeline to build? Would love to sponsor free custom PCBs/3DP'd parts if needed! (PCBWay zoey)
@LarrysWorkbench 18 күн бұрын
Thank you for that offer! All the parts have been off-the-shelf up to this point, but we're considering what upgrades we want to do next. Feel free to share the video -
@zoeyzhang9866 16 күн бұрын
@@LarrysWorkbench Sure thing! Would love to keep in touch for any upgrade service need! May I know your email?
@LarrysWorkbench 16 күн бұрын
What's your business? I'll reach out -
@Dufftata 20 күн бұрын
i wanna build one, i need a from scratch instructions together with stuff/hardware needed
@LarrysWorkbench 20 күн бұрын
You can do it! I'm posting a series of weekly video tutorials starting from the very beginning - check out Ep1 (Overview). I also have some links posted in the descriptions for parts
@Dufftata 16 күн бұрын
@@LarrysWorkbench ok so i have my own thingy build now, following your foodsteps. do you have the python script you are using somewhere around, so I only have to swap api keys
@Dufftata 16 күн бұрын
Im just using the raw hardware without motion-control-stuff
@LarrysWorkbench 16 күн бұрын
I'm planning to eventually post the Python code on Github as soon as I get around to setting up an account. Realistically, probably sometime next month. Try experimenting with it in the meantime. I found that ChatGPT was *extremely* helpful as I was just starting to learn to code....
@Dufftata 16 күн бұрын
@@LarrysWorkbench what are you using for speech recognition and text to speech?
@-RobGPT- 20 күн бұрын
NEAT 📸
@LarrysWorkbench 20 күн бұрын
Thank you!!
@-RobGPT- 20 күн бұрын
@@LarrysWorkbench np
@RoboDepot 22 күн бұрын
Also see makingmadeeasy and RobGPT for other examples like this
@LarrysWorkbench 22 күн бұрын
Thanks for referring me to those! They’re both super cool, maybe we can do a robot collab…
@RoboDepot 22 күн бұрын
@@LarrysWorkbench I am not sure about makingmadeeasy but I would bet robgpt would be interested. “Two homemade robots meet for the first time in history”
@LarrysWorkbench 22 күн бұрын
I think maybe he’s in Europe.. actually not sure. I like your icon btw - is that a HiWonder humanoid bot?
@-RobGPT- 20 күн бұрын
Aaaand subbed! @@LarrysWorkbench
@LarrysWorkbench 20 күн бұрын
Welcome, I'm honored! RobGPT is a legit social media sensation. I especially like his LCD eyes, the blinking adds so much facial expression @-RobGPT-
@X862go 22 күн бұрын
Yes 👍🏼
@LarrysWorkbench 22 күн бұрын
Thank you! Let me know what else you’d like to see
@Dasol0246 22 күн бұрын
Any plans to do a tutorial?
@LarrysWorkbench 22 күн бұрын
Yeah I have a series of videos posted on KZfaq and I’m releasing more as soon as I can get them shot, typically about once a week. Check out my playlist and let me know what else you’d like to see
@leptok3736 24 күн бұрын
Not just talk, but why not use a vision language action model? Llava or openvla, a couple of example episodes where you drive the rover or other teleoperation sets, train the model to output commands for the rover? That's the approach i started on, hope to get started on the next iteration soon
@LarrysWorkbench 24 күн бұрын
Absolutely! The two goals I have lined up next for Floyd is to integrate OpenCV so the GPT 4.o model can view its surroundings, and to give the model the ability to control the motors etc through a set of predefined commands that GPT can issue (eg \move forward\). For the last month or so I've been spending more time figuring out KZfaq than I have programming the bot (!)
@jatavathshiva3509 24 күн бұрын
The robot was awesome, can you provide a clear document how build it from scratch or the websites that help to me construct a humanoid robot from scratch please help me .
@LarrysWorkbench 24 күн бұрын
Hey there! Check out my other video where I discuss the hardware (Ep3), and I added some links in the descriptions. The chassis and arm came as a kit from HiWonder, and they have humaniod versions also. I'm posting more videos weekly. Have fun!
@jamesmoon5632 26 күн бұрын
This looks great looking forward to watching the rest of the video’s
@LarrysWorkbench 25 күн бұрын
Thank you! Let me know what you’d like to see in particular
@twirlyspitzer 26 күн бұрын
LOL - Toys talking about "nothing".
@LarrysWorkbench 26 күн бұрын
What about if we made four of them and told them to take on the personalities of the characters in the show..? Then video them talking to each other….
@twirlyspitzer 26 күн бұрын
@@LarrysWorkbench Being more of a South Park fan myself I' like to see them kill Kenny again or if that's too gruesome just be up to their usual politically incorrect but pertinant antics.
@twirlyspitzer 26 күн бұрын
@@LarrysWorkbench That should work
@LarrysWorkbench 26 күн бұрын
Lol that would be funny -
@timwallis-du6xg 27 күн бұрын
Cool. Looking forward to the next episode
@LarrysWorkbench 27 күн бұрын
Thank you! I'm typically getting them posted about once a week
@twirlyspitzer 29 күн бұрын
Fascinating & fun to follow along. What kid wouldn't kill to keep this as a darling companion?
@LarrysWorkbench 29 күн бұрын
There’s going to be unlimited applications for this technology - kids, elderly, customer service, personal assistants etc etc. Part of my message is that it’s coming fast and it’s going to be everywhere within just a few short years…..
@twirlyspitzer 29 күн бұрын
@@LarrysWorkbench Yeay for you! Keep it up !. I'm jelous that I'm not more like you. Sheer genius for the heck of it.
@LarrysWorkbench 27 күн бұрын
I appreciate your support!
@kairu_b Ай бұрын
Nice robot, sir!
@LarrysWorkbench Ай бұрын
Thank you! It's been a fun project for sure -
@Dufftata Ай бұрын
ok so this is really cool! I would like to know how the API was set up to OpenAI. I would also know your background, I guess electrical engineering/computer-science. Then, I would like to build one of those things myself, but smaller. Like how small can these things get? Anyways, 100% gonna whats this channel with high interest! Also btw: I got this recommended "out of nowhere", wasn't watching talking robot videos before. Have a nice day, Greetings from Germany
@LarrysWorkbench Ай бұрын
Danke schoen!! As the video series goes on I'll definitely talk about how the API call works. Basically I set up a user account at OpenAI which costs a few dollars, and they issued me an API key, which is just a long string. Using that key, the API call is then only a few lines of code. My background isn't really in tech, but I got interested in AI about 4 years ago and started this particular project earlier this year - maybe around February. The size would probably be limited by the size of the Raspberry Pi, the power supply and the speaker. Best regards -
@twirlyspitzer Ай бұрын
What a way to work for the fun of it!
@LarrysWorkbench Ай бұрын
Thank you for watching! Let me know what you'd like to see -
@twirlyspitzer 29 күн бұрын
@@LarrysWorkbench I'd like to see any & all atempts at self improving robots.
@LarrysWorkbench 29 күн бұрын
Awesome! I use an AI (ChatGPT) to write most of Floyd's code, but I still have to design it. I do have some ideas about allowing him to retain more long-term memories, like facts from our conversation or information about the user, but I do feel like it could start to get weird as he develops more knowledge about me or about his surroundings...
@twirlyspitzer 29 күн бұрын
@@LarrysWorkbench I guess you might have to get used to it like the movie "her"
@LarrysWorkbench 29 күн бұрын
Yeah it’s going to start to get really weird
@twirlyspitzer Ай бұрын
Home built & classroom built robots have taken a great leap forward. Democratizing tinkering saves the day. The home robot toy companion is now a reality. True independence from corporate behemoths makes life much more interesting. Thank you professor!
@LarrysWorkbench Ай бұрын
You're very welcome. It's been a fun project for sure -
@timwallis-du6xg Ай бұрын
Thanks for walking us through that
@LarrysWorkbench Ай бұрын
Absolutely! More videos coming as soon as I can get them shot. Let me know if there’s anything you’d like to see in particular
@foobars3816 Ай бұрын
Are the sounds just randomly inserted? I like it, nice touch!
@LarrysWorkbench Ай бұрын
They are! Floyd has an onboard library of short mp3 beeps and boops he plays just to punctuate his comments, and a set of longer ones to use when he’s waiting for the model to convert text-to-speech, which can take a couple of seconds. I expect that the GPT 4.o speech model will significantly speed up that lag time….
@sarvagyapandya2569 Ай бұрын
Keep it up 💪🏻🔥🔥
@LarrysWorkbench Ай бұрын
Thank you! More videos coming. Let me know if there’s anything you’d like to see in particular -
@sarvagyapandya2569 Ай бұрын
@@LarrysWorkbench make whatever you want to, we love to see it😊
@LarrysWorkbench Ай бұрын
Cool will do. People seem to find the project interesting :)
@RealSnail3D Ай бұрын
Great work man!
@LarrysWorkbench Ай бұрын
Thank you! Let me know if there’s anything in particular you’d like to see….
@bruce-le-smith Ай бұрын
please recreate a short of mst3k with floyd!
@LarrysWorkbench Ай бұрын
Lol that would be cool -
@rileybouchard4957 Ай бұрын
Thats absolutely awesome! Are you hosting your GPT locally? Wicked little project keep it up!
@LarrysWorkbench Ай бұрын
Right now it's just a Raspberry Pi connected to OpenAI via wifi. Conversational latency is a challenge but I believe GPT 4.o is going to speed that up substantially
@StrangeParts Ай бұрын
Super cool. I have a couple humanoid robots I've been trying to figure out what to do with. This gives me some ideas...
@LarrysWorkbench Ай бұрын
Go for it! Once a bot becomes fully conversational *everything* changes, and my videos will show how frikkin easy it was to do....... Btw - let me know if you're interested in any more info. I've been on youtube for just about a month now. I'm wondering if this project might actually attract a little attention -
@Ray88G Ай бұрын
More floid
@LarrysWorkbench Ай бұрын
I have Ep2 posted and more coming
@terrabyteonetb1628 Ай бұрын
It's not Ai. Unless it tries to kill you, a d says it a safety test
@LarrysWorkbench Ай бұрын
Floyd’s always been friendly. So far…
@metalheadmaker Ай бұрын
Too frickin' cool man. Amazing work, can't wait for a deeper dive!
@LarrysWorkbench Ай бұрын
Thank you! It's been a crazy project for sure. I've got an Ep2 posted and planning to continue posting an entire series. Any parts you're more particularly interested in?
@metalheadmaker Ай бұрын
@@LarrysWorkbench thanks for the response. i'm really interested to see more about how you're translating the ChatGPT responses to real-world action...which I'm sure is everyone else's interest...especially with the built in camera and 4o. going to check out episode 2 now!
@LarrysWorkbench Ай бұрын
Yeah that's currently one of the hacks. Right now the user input gets converted into text, then the local Python code checks the first words of the transcription against a list of known commands and executes if they're a match. But my next goal is to provide the entire list of known commands to ChatGPT so it can assume a greater degree of control and autonomy -
@RealSnail3D Ай бұрын
Cool stuff!
@LarrysWorkbench Ай бұрын
Thank you!
@wmmcwammer8452 Ай бұрын
hell yeah, this is one of the best projects and ideas ive seen in a long time pls make more videos that show us how we can get into building and integrating systems this looks awesome
@LarrysWorkbench Ай бұрын
Thank you! I have an Ep2 posted and I'll be releasing more as fast as I can get them recorded...
@JasonNaas Ай бұрын
Nice!
@LarrysWorkbench Ай бұрын
Thank you!
@timsarai Ай бұрын
I knew it was going to be that one 😉
@LarrysWorkbench Ай бұрын
Lol I asked him another time and he said "To be or not to be", which I guess is also interesting in an existential sort of way :/ Per your suggestions I'm going to be releasing a series of longer videos where I go through the entire build in a step-by-step fashion
@timsarai Ай бұрын
@@LarrysWorkbench that’s great to hear! I’m really looking forward to seeing them
@LarrysWorkbench Ай бұрын
Awesome. I'm still learning the ins and outs of content creation, especially trying to record decent audio. The mics don't seem to pick up Floyd's speaker real well, but I'm working on getting them configured better. He deserves to be heard!
@user-lb1mz3rd4n Ай бұрын
Nice work, really impressive! Can Floyd do anything with its arm yet?
@LarrysWorkbench Ай бұрын
He can! It has 5 individual servo motors. Check out my other video where he picks up a small green block based on voice commands -
@user-lb1mz3rd4n Ай бұрын
@@LarrysWorkbench Nice! Can't wait to see progress with the camera!
@LarrysWorkbench Ай бұрын
Yeah it will be really cool when he can actually see and describe his surroundings or even respond to visual signals. The language model GPT 4.o should support that...
@ishansharma4276 Ай бұрын
❤❤❤
@LarrysWorkbench Ай бұрын
I actually asked him about his favorite Beatle 4-5 times and I thought his answers would be random, but he said Ringo every single time(!) I thought it's interesting that he's capable of having his own preference like that...
@ishansharma4276 Ай бұрын
@@LarrysWorkbench that cool, may be you can it why do you like Ringo so much 😃
@LarrysWorkbench Ай бұрын
I'll ask him. I think maybe because Ringo keeps a steady beat and supportrs the other members of the band, just like robots support humans
@rupiter Ай бұрын
@@LarrysWorkbench lol
@timwallis-du6xg Ай бұрын
This is amazing! My son and I would love to see a walk through with a parts list and code.