Vroid - FREE Webcam handtracking !!

No video

Vroid - FREE Webcam handtracking !!

Рет қаралды 63,817

Күн бұрын

Track your hands with just your webcam…for FREE!!
A new, free webcam tracking app was released recently and I saw that not many people seem to know about it yet!
Links:
Link to the app:
booth.pm/en/it...
VSeeFace:
www.vseeface.i...
Our Discord, the VtuberLibrary:
/ discord
----------------------------------------------------------------------------
Music:
"Muffin Shuffle" by Streambeats
---------------------------MY SOCIAL-------------------------------
🐦Twitter: / theladyaska
Twitch: / ladyaska
Booth: ladyaska.booth...
Ko-fi: ko-fi.com/lady...
Patreon: / ladyaska
#VTuberguide #Virtualyoutuber #ENVTuber #VroidStudioTutorial #VroidStudio #Vroid
#Vtuber tracking

Пікірлер: 149

@LadyAska Жыл бұрын

Little head's up for everyone struggling to get the app to connect: You have to manually add the DSSbodytracker app to your firewall exceptions. (Control panel-> System and Security -> Windows Defender Firewall -> Allowed apps) I also recommend this tracking more, if you can pare it with iphone or another camera (like your phone camera even), so that you get your hand tracking from the app, but the facial expressions through iFacialmocap or another application :)

@arctos_lupus8288 Жыл бұрын

hey so it still doesn't work, it keeps giving me the "Windows cannot acces the specified device, path, or file you may not have the appropriate permisions to acces this item" and I already did the firewall stuff

@LadyAska Жыл бұрын

@@arctos_lupus8288 Ok, so when does this error exactly happen? Sounds like a problem with your webcam (my hot guess).

@arctos_lupus8288 Жыл бұрын

@@LadyAska whenever I start up the program, I double click it, it tells me to run it.. and boom error

@LadyAska Жыл бұрын

@@arctos_lupus8288 Ok, but does your webcam work fine outside of this program?

@arctos_lupus8288 Жыл бұрын

@@LadyAska it works fine

@ShiroNyankotv Жыл бұрын

The problem is you have to give up face tracking for it. Imo, not worth it. Vseeface needs a hand tracking integration with webcam.

@LadyAska Жыл бұрын

I totally agree. This solution works best if paired with a phone, that takes over the face tracking. You can either use an app to turn your phone into a second webcam or use Meowface/Ifacialmocap for Android/iPhone respectively. But I would also welcome it, if VSeeFace just had their own hand tracking integration, like webcammotioncapture.

@DIO_BRANDO. 8 ай бұрын

This took me to long to find like nobody makes free hand tracking with webcam THANK YOU

@LadyAska 8 ай бұрын

If you want something more elaborate, I would suggest trying warudo too!

@pamepittagros Жыл бұрын

Consize and straight to the point. I like it.

@THAT_LEGGY_MILES Жыл бұрын

12seconds in. My brain went "MISTER BEAST!!!!!!"

@ritalindayt Жыл бұрын

Thank you! It worked for me. Now I just need to get my expressions to work. Doesn't trigger sadness, happiness etc when I try to make the emotions with my face lol

@LadyAska Жыл бұрын

I can give you a little hint already, but there will also be a video about thst in the future. If you use your webcam for hand tracking already, you won't have another device to track your face (if you don't have a compatible iphone for tracking) If you have any phone with a camera, thereare various apps out there, that can turn your phones canera into another webcam so to say, which you could then use as your seperate face tracking device. They usually get picked up pretty well by VSeeFace too :)

@ritalindayt Жыл бұрын

@@LadyAska Thanks! I figured out a way to do it 🤗

@Merlin_san_ Жыл бұрын

thank you for the quick and easy tutorial

@LadyAska Жыл бұрын

You are welcome! Glad it's helping :3

@casualdoomer8277 Жыл бұрын

This is awesome, thanks Lady A.

@LadyAska Жыл бұрын

You are welcome! :D

@Nekotico Жыл бұрын

Thanks for sharing Aska

@LadyAska Жыл бұрын

You are welcome :D

@EmoChipmonkVOD 5 ай бұрын

Really odd tip. Dont expose your sholders if your bigger. For some reason it thinks my left sholder is my left hand.

@LadyAska 5 ай бұрын

Thank you for the tip! I saw some trackers would pick up on the background as well. The more your hand can be made out from the rest of your body, the better, usually :)

@mbhahn Жыл бұрын

Thanks for the wonderful video!

@LadyAska Жыл бұрын

I am so happy that I was able to finally release one again this week! :3

@wolventtv Жыл бұрын

Hi! Im having issues with VseeFace, im not getting the option for a virtual camera no matter what I do, DSS is working perfectly but VF is stuck on a T pose, any ideas?

@LadyAska Жыл бұрын

So your only option would be your webcam, (which now is in use by the DSS tracker) and you are unable to change it to any other camera option (not even on startup)? I never heard about that problem...if you don't use the DSS tracker, can you set a virtual camera before in VseeFace? If yes, do that, as VF will save that option. Then set up the Port, to receive the DSS tracker, as shown in the video.

@sterlingdowall2975 Жыл бұрын

I am a minimum wage worker i have been waiting for something like this forever! Oh i can't wait to install this and try it myself.

@LadyAska Жыл бұрын

Then I really hope it does work for you! :) See the pinned comment for additional advice, in case you are having trouble setting it up.

@NainPosteur Жыл бұрын

Thank so much, Great tuto! it work verry well!

@LadyAska Жыл бұрын

Awesome that it helped you! :D

@moras6519 Жыл бұрын

Thank you, you helped so much! :)

@LadyAska Жыл бұрын

Glad it helped! :D

@Fabricio-- 7 ай бұрын

OBS virtual don't appers on camera options

@LadyAska 7 ай бұрын

Hello! I think you have to have OBS installed for it to appear (but not sure, since it was always an option for me) Let me know if that solved the issue!

@MegaLewdSlime Жыл бұрын

Do you know how to open camera settings while in VSeeFace? In OBS it's easy to do, but in VSF? Like I want to adjust some setting, like Hz and exposure

@LadyAska Жыл бұрын

I don't think you can change the camera settings at all, because VSeeFace is using your camera "as is", for the tracking. At least I am not aware of such an option :)

@conductingintomfoolery9163 8 ай бұрын

That thing glows

@GamingMaster4386J7C Жыл бұрын

I have problem with using it. My mode wrist looks warped when moving it. Not sure how to fix it. I notice you didn't have that problem with your model. Is your model VRoid Studio made or custom made using other software?

@LadyAska Жыл бұрын

It's a standard Vroid model. Was your model modified by any chance? (I know of Vroids warped ankles, but the wrists were usually ok :/ )

@FleischYT Жыл бұрын

Just tested DSSbodytracker with VSeeFace, but looks like the finger animation is like super slow animated in VSeeFace. Any Idea why ?

@LadyAska Жыл бұрын

I suppose your PC can handle running these two programs together? Besides that, I can only imagine it being a problem with the protocol itself, but all that would be on the developers.

@trust3319 Жыл бұрын

its working thank you so much

@LadyAska Жыл бұрын

Awesome, enjoy! :)

@Nmixxer14 7 ай бұрын

great tutorial!

@LadyAska 7 ай бұрын

Glad you found it helpful :)

@iEL_Rivale Жыл бұрын

Does it work with VSeeFace if you import your own custom model? (Not make with VRoid. Made with Blender y´know?) Or if it has two "skeletons" or "armatures"?

@LadyAska Жыл бұрын

I couldn't test that yet, but I imagine that it either won't work or look more wonky as it was optimized for Vroid models. Feel free to test it yourself, if you have a non Vroid model available and let us know how it went. :)

@iEL_Rivale Жыл бұрын

@@LadyAska It worked! But it looked horrible! I guess i gotta wait for a leap motion device :-D

@LadyAska Жыл бұрын

@@iEL_Rivale Thank you for the follow up! :D

@iEL_Rivale Жыл бұрын

@@LadyAska You are welcome!

@PARAPPATHERUBBER 9 ай бұрын

i’m on ipad, can you make a tuto for ipad?

@LadyAska 9 ай бұрын

lHello! Can you explain to me what you mean? Like the ipad as a webcam?

@PARAPPATHERUBBER 9 ай бұрын

@@LadyAska Because on iPad for me is pretty hard to use and idk how to do the face tracking or hand tracking on my iPad, I'm sorry if I'm bad at explaining

@LadyAska 9 ай бұрын

@@PARAPPATHERUBBER I’ll look into it. I don’t have an iPad, but an iPhone. If your iPad has the “unlock through your face” feature, you should be able to install a tracker on there and use it basically as a webcam. BUT in this case I would suggest to use it as your face tracker and not for your hands. ( that would be kind of a waste 😅) Do you have anything else, like a phone or a regular webcam, that you could pair with your iPad or are you in general more using it as a PC replacement. (Meaning you are running VSeeFace on there, instead of a PC)

@PARAPPATHERUBBER 9 ай бұрын

@@LadyAska Oh okay thank you!

@PARAPPATHERUBBER 9 ай бұрын

@@LadyAska I do have a PC I'll ask my dad to download it

@sashaalentorn491 Жыл бұрын

Hi! Thanks for the free hand tutorial! But it seems like VSeeFace stop the Audio Lip Sync when the OCS/VMC receiver is eneabled? (at least that's my case) Maybe you know a way to fix this? Thanks!

@LadyAska Жыл бұрын

I didn't hear about this yet. Maybe you should ask the VSeeFace Developer about this one, because that wouldn't be good in general, no matter with which other application VSeeFace is paired then.🤔 This is her Twitter/X account and she is usually open to feedback. twitter.com/emiliana_vt?t=UOvtZXGAwmI8qvFz64gfdA&s=09

@sashaalentorn491 Жыл бұрын

@@LadyAska Thanks for the quick answer! Yes, I already contacted the Dev a few days ago, still no response yet... So this is a new bug? Haven't you noticed this when recording your tutorials? (just curious hehe)

@Nightyy0 11 ай бұрын

doesn't work for me, whenever I have face tracking enabled on vseeface, it crashes when I click wmc send

@LadyAska 11 ай бұрын

What are you using for face tracking? :) I thought it was obvious that the webcam can only work with one thing (either the hand tracking or the face tracking), which means in this case, face tracking has to come from another camera (like a phone for example). I apologize that this wasn't clear. If you are using another source for your face tracking already, give a look how much processing power is used for everything together and if that causes the problem. (in which case I would just leave the hand tracking out for now, if you are streaming for example )

@Nightyy0 11 ай бұрын

@@LadyAska I did'nt know the thing about one camera for one tracking, but even if I disable face tracking it still does not work. Does it work with like an Iphone 5 ?

@ohani.studio Жыл бұрын

Hi lady aksa. Thank you for the tutorials. The first downloaded application won't open on my pc. Any idea why?

@LadyAska Жыл бұрын

Hello! Do you get any errors? And did you unpack the app completely? (without more information it will be really hard for me to help 😶)

@EziosBladez Жыл бұрын

My avatar in Vseeface T-poses then never unlocks at that point :(

@LadyAska Жыл бұрын

Try the app from the original developer instead, it's called "VRigUnity" and see if you got more luck with it. I didn't know, that the software in this video was basically a rip-off, of another program.

@EziosBladez Жыл бұрын

@@LadyAska I'll look into that, thank you.

@shivangipriya4153 Жыл бұрын

Thank you, but the hand is shaking what is the solution during the move???

@LadyAska Жыл бұрын

Try downloading the original project VRigUnity and see if you get better results. Apparently this one is just a bad made copy. (which I wouldn't know, if the original creator didn't reach out to me)

@shivangipriya4153 Жыл бұрын

Thank thank you so much :-)

@FerShibli Жыл бұрын

thanks Lady Aska!!

@LadyAska Жыл бұрын

You are welcome! Have fun! :)

@I0NYe Жыл бұрын

can we use it in games such as Roblox and gorilla tag ??

@LadyAska Жыл бұрын

Not that I know of unfortunately. This is more for people who stream and want hand tracking on their Avatars. You can't use it to replace VR trackers or the likes.

@shivangipriya4153 9 ай бұрын

I have two questions: Q1: I could not make lipSyn like you correct I try my best I cannot any suggestion ? Q2: I found on VseeFace " load and paly auido" on General sitting But how it is work ?? can you please show me this

@LadyAska 9 ай бұрын

For the lip sync you need only your mic, to have the audio drive your mouth and not your actual mouth movement. But if that isn’t for you and you want move your head and mouth like they move in real life, you would need a second cam. Like a phone that you can use as a second webcam for example. :) I never tried the load and play audio option. Where did you find that one? Thank you!

@shivangipriya4153 9 ай бұрын

Ok, thank you so much fro your answer... if there is way to meet you please I need your email>> if cannot no any problem ..thanks :-)

@yendia Жыл бұрын

my mouth is flickering when when i add this but everything else work

@LadyAska Жыл бұрын

That's why it's best to pair this, with a camera just for face tracking. You can either use your phone as a second cam, with a phone to webcam app or based on which type of phone you have select one of the available tracking apps for it. For Android I recommend Meowface and for iphone, ifacialmocap. :)

@yendia Жыл бұрын

Thank you for the reply but I have a face camera with my setup. It vseeface works perfectly capturing my face. It’s just when I set up the hand tracking it gets jittery

@xvstudios Жыл бұрын

Running into an issue where I select my OBS Virtual Webcam and my model in VSeeFace completely stops moving... I have the port setup complete, and the virdual camera in DSS is running... what am I missing?

@LadyAska Жыл бұрын

Did it work before you switched to the virtual webcam? I am asking, because the tracker is weirdly sensitive. Which means first: your webcam has to be used by the tracker "first", which means, you have to open the tracker program first and VSeeFace, when you open it and it was set ro that webcam, will give you a message like "no webcam found". Then start the tracker and see if it translates over. In the pinned comment I also gave a little guide on how to work through the system settings, in case they block communication.

@kavvwithlove0231 Жыл бұрын

@@LadyAska Hi, I'm having tha same issue, tried everything in the comments and still not working:C

@nasimansari6041 10 ай бұрын

suggest low graphics requiment software

@LadyAska 10 ай бұрын

VSeeFace can be customized to work on a "potato"-mode. Which means even a PC with less than optimal processing power should be able to run it. If you are talking about low graphics requirements, I suggest looking into PNG-tubing. As working with 3D models inevitably use more graphics power. You are welcome.

@nasimansari6041 10 ай бұрын

@@LadyAska Where i can find this options

@geram_g_ Жыл бұрын

Muchas gracias

@GatoSancto Жыл бұрын

i have add ddsbt to allowed apps already i tried with obs running and closed, i use my webcam, put 3333 number on both apps but my model still in t-pose on vseeface

@LadyAska Жыл бұрын

It could be a number of things. Is the app at least working if it isn't paired with anything? And do other apps work normal, when you pair them with VSeeFace? (if you ever tried that) It will be very hard for me to help you from here, sadly.

@GatoSancto Жыл бұрын

@@LadyAska it's not paired with nothing, i've not tried to pair other apps with vseeface yet, i'll try

@RickaFox Жыл бұрын

TNK YOU!!!

@LadyAska Жыл бұрын

Happy to help! :D

@orkedits 7 ай бұрын

Hey Aska, is it possible to export the tracking data to Blender or other animation software?

@LadyAska 7 ай бұрын

Hello! I tried that, but so far no luck...my test was with Unity, with a plugin that could receive the data over OMC...but I couldn't get it to be imported specifically for animations. So while the transfer from my tracking/posing etc. was successful, I couldn't "use" it after in any meaningful way. If you have more luck, let me know :)

@orkedits 7 ай бұрын

@@LadyAska Thank you for the quick reply! I'll let you know if I manage to get it working.

@mindlessguyrepulsr4093 Жыл бұрын

can you possibly play vr games with this? just asking...

@LadyAska Жыл бұрын

With the webcam tool? No, it doesn't replace VR trackers or anything. With the model itself? Yes! Depending on the game you try to play, you have to use different methods to get to use it in VR.

@_NokiPlays Жыл бұрын

Hey, so im struggiling a little bit, do i need both of the apps VFace and the other one, or just one for them? I dont really understand, its my first time so yeah 😅

@LadyAska Жыл бұрын

Hello! So you would need this app shown in the he video and the VSeeFace app(also shown in the video) The idea is that you only send the hand tracking over and that you will track your face over Meowface (android) or ifacialmocap (iphone) , that get also send over to VSeeFace. (now that sounds even more complicated, doesn't it 😅)

@_NokiPlays Жыл бұрын

@@LadyAska yea 😅😅 basiclly both apps?

@martpetrakk Жыл бұрын

It tells me that it could compromise the computer

@LadyAska Жыл бұрын

I recommend getting the original version. Without me knowing, this isn't the original version of the software. Either way, this message is normal, as this program was made by an independent developer. So for security reasons Windows wants to make sure, that you know that and that you understand the risk that theoretically comes with software like that. (so in short: even if this isn't harmful, windows has to make sure that you take responsibility) Here the link to the original software. (also by an independent developer) github.com/Kariaro/VRigUnity

@finnleyjack331 9 ай бұрын

Why is it so slow?

@LadyAska 9 ай бұрын

That could have multiple reasons. The app isn't slow per se, as you can see in the video. So maybe your PC is not able to handle it. I am not the developer of this app, so I don't know if it does have some limitations for example.

@cristinevalois4938 Жыл бұрын

Not working for me 😢

@LadyAska Жыл бұрын

What exactly isn't working? Maybe we can figure it out. Did you try the troubleshooting mentioned in the pinned comment? :)

@cristinevalois4938 Жыл бұрын

@@LadyAska oh, it actually worked after 5 minutes, the hand tracker just gave me a late response

@krispynchewy 6 ай бұрын

This does not work...

@i_estrea Жыл бұрын

Can I make it 2d and not anime?

@LadyAska Жыл бұрын

Probably not, at least not with this one, as it's pretty clear, that it only seems to work with the Vroid standard. (Maybe with other 3D solutions too, but I haven't tested that yet) But it won't work for 2D.

@martpetrakk Жыл бұрын

and can i use it as webcam on discord???

@LadyAska Жыл бұрын

There is a way to set your avatar up for Discord (instead of a webcam of yourself) If you like, I can make a separate video about that and how to set it up. :)

@martpetrakk Жыл бұрын

@@LadyAska ok that gonna helps me thanks

@googletube-ej4bm Жыл бұрын

The link is unvalid

@LadyAska Жыл бұрын

Thank you, for letting me know. Will check if there is an update to it, otherwise I will remove the video, if the program isn't available anymore. :) (as said, I am just sharing the program, I am not involved in the creation)

@LadyAska Жыл бұрын

I checked the link and its still working, so there must be a restriction for you, that has nothing to do with the validation of the link itself. Maybe try to acess it via a vpn

@anabellarivolta 10 ай бұрын

is there a way to mix this with vrchat?

@LadyAska 10 ай бұрын

Hello! Not that I am aware of sadly. :/

@LuiGame03 Жыл бұрын

can i use for handtracking on vrchat?

@LadyAska Жыл бұрын

I don't know enough about Vrchat yet, to know what is compatible or not, sorry 😅

@pablos8336 Жыл бұрын

will this work on facerig?

@LadyAska Жыл бұрын

If facerig allowes for the VMC protocol to be received, then yes. I know VUP for example supports VMC. I don't know about Facerig and you would just have to see, if you find a VMC option there. It will work with the same port then and all :)

@dreamywonderland1490 Жыл бұрын

is it safe? to download? cause it says it might put my computer as a Risk. 🙏

@LadyAska Жыл бұрын

It's a free to use software made with available resources online, but all in all was only made by one guy. Usually they have to put a warning up, that any software that is not specifically licensed , is a potential risk for your PC. I recommend that, if you don't feel safe using it, don't use it. I can't guarantee if the program will have any potential risk attached to it, I found it, tested it and told everyone about it and my PC didn't light up in flames yet or displayed any other trouble.

@sirottar8164 Жыл бұрын

Deutsch? xD gutes tutorial

@LadyAska Жыл бұрын

Ja, wissen nicht viele ;)

@sirottar8164 Жыл бұрын

@@LadyAskaIch finde das hört man einfach raus was ja aber nicht schlimm ist.

@AvaGirlGamingOffical Жыл бұрын

is this a scam

@LadyAska Жыл бұрын

What do you mean? This is free software, that is not taking any of your information or money.. The thing I didn't know, when I recorded this video, is that this is not the person's original work. It was an unfinished prototype of another developer, that this person took and released as his own. The original software is still being developed and updated.

@LadyAska Жыл бұрын

The original software is called "VRigUnity".

@AvaGirlGamingOffical Жыл бұрын

@@LadyAska my dad said it look like a virs and i trust everything my dad says so very sorry if i ofend you

@AvaGirlGamingOffical Жыл бұрын

virus*

@LadyAska Жыл бұрын

@@AvaGirlGamingOffical No offense taken at all, since I am not associated with any of this. I was just wondering where you took the "scam" thing from, but I understand now, that you meant "virus". Some Indie developer programs may look less polished, but that doesn't mean they are or contain viruses. If you wanted to try it, better get the original developers work though, instead of this.