Ultimate Vtuber Application! FREE! Hand Tracking, Face Tracking, Body Tracking

No video

Ultimate Vtuber Application! FREE! Hand Tracking, Face Tracking, Body Tracking - VSeeFace

Рет қаралды 154,107

Fofamit

Күн бұрын

Пікірлер: 226

@fraizineberry7623 3 жыл бұрын

If I'm poor what hand tracking/ finger tracking should I use? Anything as long as the hands move it's fine.

@MrRourk 3 жыл бұрын

Find a Xbox kinect and a usb cable.

@queeffersthrlnd1620 3 жыл бұрын

@@MrRourk do you need any program or does it just work with vseeface? Or do you need the vmc thing from patreon?

@MrRourk 3 жыл бұрын

@@queeffersthrlnd1620 not sure what software you will want to use. The kinect has been around and used for a long time kzfaq.info/get/bejne/fM2Vp8iat9LIhIE.html

@MrRourk 3 жыл бұрын

@@queeffersthrlnd1620 kinect 360's are super cheap. But have small usable field of view.

@KaiTheBreadBoi 3 жыл бұрын

@@MrRourk Dies the software you use allow imported avatars and stuff like vseeface

@Fofamit 3 жыл бұрын

You can still use regular webcam tracking for basic face tracking! But the new update allows for full facial tracking and this video shows you how to do it~ You can also capture full body motion capture through a similar method as well :)

@PhantomDragonexe 3 жыл бұрын

so we don't have to purchase an iPhone to track and can use just a webcam if we can't really shell out the money for the leap motion just yet? Do you know if you can upload 2D rigs to this as well? Sorry that's a lotta questions in one go. Thank you by the way for this video, very informative and to the point.

@itsmemaldy7071 3 жыл бұрын

And for android ?

@judaslink3588 3 жыл бұрын

MystykM Art as of right now I don’t think any 2d rigs like live2d can use hand tracking or 3D tracking. I think they have to be made with vroid and blender

@judaslink3588 3 жыл бұрын

Its me Maldy Android currently doesn’t have Face ID which is what these programs use for detailed face tracking. Like winking and accurate mouth movement

@emi_vt 3 жыл бұрын

Thank you for making this guide! 4:14 If this only happens when any blendshapes are activated, this issue is actually caused by Unity calculating incorrect blendshape normals when importing the FBX. It can be fixed by changing "Blendshape Normals" to "None" in the import options of the FBX before exporting it to VRM.

@nyuchuarchive 3 жыл бұрын

VSeeFace always been here for us! 👀

@RiyaCelesiar 3 жыл бұрын

program: free requirements: not free

@oalexo 3 жыл бұрын

freEEeEeEeeEeEeEeeeeeeEeEeE

@v3x796 2 жыл бұрын

oml ur the funniest vtuber ive ever seen on yt

@elsemusic3550 3 жыл бұрын

Is there any full facial tracking option for non-iphone users? I'm having so much trouble finding anything!!

@kwekdc9006 3 жыл бұрын

Ikr me too! i only have android

@mcmeadow8591 3 жыл бұрын

I came here to ask this question as well

@thefoxmoonlight 3 жыл бұрын

VUP on steam, I cam here to attempt to spread the word of this app (since its much easier to setup) but this girl/boy (sorry the voice is hard to tell T_T) deserves recognition not hate comments.

@gonasf 3 жыл бұрын

Lol android

@MrFelblood 3 жыл бұрын

Anything that works with the VMC protocol should be fine. We'll probably see a lot of new contenders on the marketplace now that VSeeFace has thrown their weight behind VMC.

@KomsaSword 3 жыл бұрын

Looking to get into vtubing and this channel has been the most helpful source thanks so much! Subbed and liked!

@AlyCatVR 3 жыл бұрын

Man, I'm glad I've been pushing VSF for people new to the VTubing game. Shame that the Face ID app is exclusively for Apple (I'm an Android only user), but all in all, wonderful information!

@ShonenVR 3 жыл бұрын

I don't understand the role of the phone in all that we have to place our phone in front of us the whole time ?

@AlyCatVR 3 жыл бұрын

@@ShonenVR I think it's facial tracking data?? I've never seen or used an app like that, so I couldn't tell you unfortunately. ;(

@emi_vt 3 жыл бұрын

@@ShonenVR By using Waidayo on an iPhone, you can get some more detailed face tracking and do things like stick your tongue out, as long as your model has the necessary blendshapes. Android's face tracking SDK is not quite as advanced and the regular camera tracking probably already gives better results. Of course you can also use VSeeFace without an iPhone and track your face using a regular webcam.

@elsemusic3550 3 жыл бұрын

I'm on android too, have you found a way to do full facial tracking without the iphone?

@emi_vt 3 жыл бұрын

@@elsemusic3550 Android's ARCore face tracking is sadly not that impressive, so just it won't really give better results than just using the regular webcam tracking.

@IBubblesTV 3 жыл бұрын

Bruh I same to the video thinking I didn't need leap motion 😭

@charlizelima4565 3 жыл бұрын

same here lmao

@ako5481 3 жыл бұрын

At home I have the Xbox Kinect, does it work with the application?

@slaveNo-4028 2 жыл бұрын

can you leave the Iphone part out? Like will a webcam suffice in producing some kind of face tracking? Or lets put it this way, if you save up 150 bucks, should you invest it into a leapmotion or a used, broken-display-ed Iphone X?

@starii2173 2 жыл бұрын

Me on pc: *Fades away*

@ThatHippyDuck 2 жыл бұрын

HAHA. *FREEEEE^ that was adorable

@underbelly69 3 жыл бұрын

tried Luppet demo (has leap + iphone face tracking but USD$60), and then tried 3tene (it's free + has leap, but no iphone integration) - then BOOM this! best of all worlds - and very responsive = LOVE IT

@rosabellewakefield5444 3 жыл бұрын

Is there a method for those of us with good phones?

@EvanthePixelPusher 3 жыл бұрын

For some reason this does not work for me. My computer is on the same network, the port numbers are the same. Am I supposed to change it from what it started with to a different number? For some reason my webcam pick me up but I get nothing from my phone and I am using an Iphone XR. Also Im not sure if you knew at the time but newer versions of VCface do not have the VCM recieve feature I had to back track to the same version you used in this video (1.13.34c) in order to find this feature in the options.

@RichDiamond11 3 жыл бұрын

so is there a way to do this with just the pc and webcam

@EmulationGuru Жыл бұрын

Your tuts are the best. I set this up in minutes yesterday

@MadiiiWorld 3 жыл бұрын

i clicked this video so fast soon i saw free

@kr1s_d3ltarun3 3 жыл бұрын

At first i thought he was doing ASL while talking because he was moving his hands so much.

@Weredah 3 жыл бұрын

Something about one of your timestamps tells me you like to watch VCR Repair Men

@martinwettig8212 2 жыл бұрын

You forgot to mention it's Apple exclusive. Wouldn't hurt to put that into the title.

@gabriellecomeau2338 3 жыл бұрын

I love your channel ! Good job on the tutorials and fofamit ...she's very cute ! ❤❤❤

@doomblackdragon 3 жыл бұрын

Is there not a program that tracks hands using your web camera like normal cam streamers.

@essential4595 3 жыл бұрын

You call it free then say you need an iPhone 10 or whatever it was :(

@trashlambo 2 жыл бұрын

1:02 - Subtitles: "Enderman Vwoops"

@okaybutwhythough7456 3 жыл бұрын

Every KZfaqr in the last 6 months: *LOOK AT THIS GRAPH* *EVERY TIME I DO, IT MAKES ME SAD* *AND WHEN DID OUR EYES GET SO RED?* *AND WHY THE HELL ARE YOU NOT SUBSCRIBED YET?*

@summer8810 3 жыл бұрын

What if your phone has face id but you don't have an iPhone?

@Fofamit 3 жыл бұрын

Needs to be an iPhone since Apple is the only one who has developed an SDK which people can access for free.

@3v1l73ddy 3 жыл бұрын

Any way to track arms and hands without leap motion? Even just basic tracking?

@MadHouse_Eboy 3 жыл бұрын

I AM TOTALLY GOING TO DO THIS. :)thank youuuuuu

@animatoonstv.2216 2 жыл бұрын

Hi, does anybody know why the smart phone has to be connected? She said the web cam is the one tracking the face I do not understand. 🙄🙄😨😨

@Assortment54321 2 жыл бұрын

Thanks for this video! You are an adorbs person. :)

@telstraroenssel3701 3 жыл бұрын

is the leap motion camera thingie a must for better eye track and hand track? they r now working for with only webcame while the rest works quite nicely :)

@watson9692 3 жыл бұрын

So I want to be just hand-tracking, how can I do it? Not a whole body just a hand. It for my school project.

@fish1798 3 жыл бұрын

Omg thank you so much!

@Nekotico 3 жыл бұрын

can i use kinect to track my hands? im a digial artist and i starting to sell avatars and i need to be sure it wokrs propertly before haha....ty for share this info

@underbelly69 3 жыл бұрын

leap motion is best bet

@zukio6088 3 жыл бұрын

omg why didnt i think of this

@SargHWP 2 жыл бұрын

Hey what the best software for hp laptops and not sketch

@Karlobster923 3 жыл бұрын

I'm wondering where exactly you position your iphone for this? since I can't put it straight in front of me (bec I won't see my PC screen lol), its angled upward on the desk and my avatar keeps looking up and all over the place lol How is yours looking straight at the cam?

@mezzovii 3 жыл бұрын

seems like vtubers always forget that not everyone has an iphone

@SG7Music 2 жыл бұрын

If you have Android, Meow Face can give similar results.

@neonrainbow9033 3 жыл бұрын

can this be done with an Xbox360 camera?

@baehaqi30 2 жыл бұрын

I like your tutorial

@mediaisekai2935 3 жыл бұрын

got a problem, everything is setup with my avatar on the app and i put in the setting but none of the iphone info is applying to vseeface

@frosty-vlogs 3 жыл бұрын

what about android

@supremefearow7053 3 жыл бұрын

this youtuber needs more attention

@GregJoiner Жыл бұрын

And if you are not an iPhone user and use Android instead?

@MyHeartsKingdom 3 жыл бұрын

I have a question, when trying to test my facial/body/simple movement tracking the fps says it’s around 9 or 10 and I move around slowly. Is there any way to bring the fps up back to 30? I set up my camera to 30 fps

@crazywyvern4704 3 жыл бұрын

i have an android with face stuff, it sucks this doesn't support android

@call_me_hoja 2 жыл бұрын

When i move, it takes 3 or 5 secs to move the avatar, its annoying, how do u fix it

@st4rxs_ 3 жыл бұрын

my veeseeface tracking is not working

@St4rlighht-p1d 3 жыл бұрын

I spent £8 on ifacialmocap when I could of used waidayo😭

@vincentturchetta8788 3 жыл бұрын

Is there anything we can use if we don't have an iphone? VSeeFace's own tracking is Passable in some situations and I'll def be playing with those settings but I have an android and won't be getting an iphone just for this. The leap was a good purchase but I can't justify a phone I won't use otherwise.

@vincentturchetta8788 3 жыл бұрын

Oh and is there any good recommended ways to position the leap and my keyboard to make my avatar track/look like I'm at my desk? So that it's less stiff while I'm gaming and not actively doing anything with my hands.

@Fofamit 3 жыл бұрын

On your neck/chest

@SG7Music 2 жыл бұрын

If you have Android, Meow Face has decent tracking. Better than basic webcam anyways.

@redjack2629 3 жыл бұрын

You missed one. Threedposetracker is a nice compliment for Vseeface, too. :P

@interlewdcreations5604 3 жыл бұрын

It looks like you are using a neck mount for the Leap Motion controller. Can you recommend where I can buy a good neck mount?

@therigwinmivtuber4372 3 жыл бұрын

Thank you. Just found your channel. I have been trying to use Luppet with a leap motion for some things, other things I use my HTC Vive with Eye Tracking in Virtual Cast. But this looks incredible. I am going to have to give this a try later today. Do I need to do anything if I made my avatar in VRIOD studio or should the VRM file just work?

@Fofamit 3 жыл бұрын

For use in VSeeFace you can only use VRM. So since you already have one you should be good to go :).

@therigwinmivtuber4372 3 жыл бұрын

Got it installed. Here is a nice thing about waidayo it allows you to load your characters from VROID that you upload to pixiv. So I got the face tracking via my iPad Pro perfectly with my avatar. Still trying to figure out the leap motion. Rewatching the video to figure that out. So here are some questions, I have Vive Trackers and a HTC Vive Pro with eye tracking. So to do the full body tracking, I don’t wear my headset do I? Cause that would mess up the iPhone face tracking. So do I put a tracker on my head? I have 5 of them, originally for waist, foot, foot, elbow, elbow. (For Virtual Cast). Thanks for your time and have you thought of doing a Collab with PhiaBunny over on the Virtual Reality Show?

@Fofamit 3 жыл бұрын

Yes you can use a vive tracker on your head instead of using a headset. Make sure you are using Virtual Motion Capture (VMC) to send the motion data or another application which can send OSC motion data to VSeeFace for full body tracking. I would love to do something with PhiaBunny in the future~

@iSahphie 3 жыл бұрын

you said for more info at 4:08 check out this video but i can't find that video omg :(

@munchkinmochi1412 3 жыл бұрын

so the face tracking is only for iphone oof

@shugooii1434 3 жыл бұрын

I have a question what about the battery live of your iPhone?

@Konfettimusic17 3 жыл бұрын

im poor and don't want to use a device for hand tracking is there any way i can do it without a leap motion controller?

@vieatiran2703 2 жыл бұрын

What are you using right now

@Lxcid279 3 жыл бұрын

Anything I can use for face tracking and hand/finger tracking for free without leapmotion

@QueenMsp 3 жыл бұрын

Can I use my iphone with face id for a webcam if I dont have one

@aethert0ast 3 жыл бұрын

thanks, i make yt videos n stream and hate how i look so i turned to mocap.

@Awesomwott 3 жыл бұрын

Asking for a friend, they don't own an iphone. So I was wondering if you have other videos for face tracking without iPhone

@Will_Is_Coming 3 жыл бұрын

Will it work with Kinect Xbox one?

@turtleeatstomato8572 2 жыл бұрын

is there any free way to get some sort of scuffed webcam powered body tracking in vseeface?

@1of1xd 3 жыл бұрын

i thought u meant something when0 yo said free finger

@leoace5614 2 жыл бұрын

what about for iPad?

@bettyyeet2453 3 жыл бұрын

Will a iPhone 12 Pro max work as well?

@misticnight6118 3 жыл бұрын

Will it work with glasses

@pogdog8655 3 жыл бұрын

Can we do it with mobile camera?

@kakushonen 2 жыл бұрын

free.

@tokyohanamura 3 жыл бұрын

That last part though... god that was the hand tracking problem I had 😂 Only thing is... is there a way to hide the Leap Motion 3D model in VSeeFace after correctly positioning it? I’m worried that it’ll look awkward with the 3D model hovering around the neck or chest area on stream

@Fofamit 3 жыл бұрын

Yes you just close the settings menu for Leap Motion Settings.

@tokyohanamura 3 жыл бұрын

Everything seems to function fine now, but occasionally the hand tracking will get wonky like the arms popping into place where my actual hands are or just floating. Pretty sure I gotta just mess with the reaction time settings some more, cause the visualizer shows it’s able to track the hands perfectly even when switched to head mounted mode

@hiyokosaionji4910 3 жыл бұрын

verseeface doesn't work on pc and why in waidayo I see no character on pc like how do I import it?

@underbelly69 3 жыл бұрын

do you mean VSEEFACE ? it's working for me on PC Omen laptop, with leap motion, iphone waidayo app = magic

@Alabaresta 3 жыл бұрын

But, but... I don't have an iPhone 😔

@overlord_ora7648 3 жыл бұрын

So you can use the vive trackers for full body here too O: ? I see it in the description. At 4:00 it's probably one of those check box options to turn it on?

@Fofamit 3 жыл бұрын

Yes if you use Virtual Motion Capture to pair with it~

@battychaos4169 2 жыл бұрын

What if I don't have an IPhone? Is there other apps for Android phones?

@thewaba5167 3 жыл бұрын

Is there a android Waidayo equivalent? Cause my phone does have facial reconnection but I cant find the app there so, any ideas of other good apps?

@SG7Music 2 жыл бұрын

Meow Face

@annat.500 3 жыл бұрын

I'm on mac and the only program I found was 3tene and it doesn't even really track my lips :,( Does anyone know a better program for mac?

@estellastardust1159 3 жыл бұрын

I cant figure out how to send the info from waidayo to vseeface and there's only this tutorial to base it of. I tried googling how to co nect everything to the same network and i am not having much luck. I dont know what else to do

@cppgamingchannel3915 2 жыл бұрын

Hi, @UCFFFT9fux06NW1Q9QeccJlA. Thank you for the tutorial. I wonder I have to get the Leap Motion Controller in order to get the hand and arms tracking, is that right? thank you

@lazyt3ddy482 2 жыл бұрын

Are these custom or there own design they want

@NiteSek4804 Жыл бұрын

bro lol.... I'm not buying a faking iphone man. Never have, never will lol.... Some of us are hardcore PC enthusiasts. We don't SUPP Apple, & there are soooo many good reasons we don't. Only trendguru's buy Apple phones man. Why do you think people like LinusTechTips, GamersNexus, BitWit, JaytwoCents & so on don't own iphones for their own personal use? ?... I have an ROG 6 Phone man. So uh, i'm going to need you to stop mentioning that over-rated phone that severely needs to stop being a trend already. Not all of us are on that bandwagon bro lol

@connor-sw1hl 3 жыл бұрын

Does it work with 2d models? or just 3d?

@josephpalmer691 3 жыл бұрын

is there a way to do it without i phone?

@cafe8162 3 жыл бұрын

Fofmait can u do A vtuber App with no leap just webcam?

@JackieJKENVtuber 3 жыл бұрын

What if I just want to use VR? Can I use VR in conjunction with VSee face? My idea is just to have my stream on one side and on the other side my model with both the head and the hands tracked in order to interact better with my public

@menjivarTv 3 жыл бұрын

Does this work for 2D models?

@annetterains7927 3 жыл бұрын

video idea: How to dowload a avatar from fiverr to vseeface

@shaper_i-o 3 жыл бұрын

Is there an android substitute for waidayo?

@dingodooo1882 2 жыл бұрын

and can it be done with android?

@theOneJello 3 жыл бұрын

can i use this for steam vr

@warlockeshane 3 жыл бұрын

Love your videos! I want to try this app but it doesn't look like it works for Mac. Do you have any software you can recommend that is compatible with Mac?

@Fofamit 3 жыл бұрын

Unfortunately the only Mac Vtubing application requires the use of an ipad or iphone with faceID. So like an iPad Pro, or a iPhone X or higher. If you do have an iPhone/iPad with FaceID then this video will help: kzfaq.info/get/bejne/asd2gtV5sbidYY0.html

@ByTheOrderOfPeakyBlinders 3 жыл бұрын

The whole video: you can check this video here😂

@atombomb54847 3 жыл бұрын

idp.generic is apparently one of the files in veeseeface which my antivirus and google identifies as a virus. Could it be a false positive?

@Sasha-lc8hv 2 жыл бұрын

Can you get one for android?

@meowmeowm30w 3 жыл бұрын

When using vseeface and I have issues with the eye tracking. Everytime I turn the motion/sensitivity up the pupils shoot up and to the right in its own so now idk what to do :(

@telstraroenssel3701 3 жыл бұрын

same problem here. and it doesnt track my shoulders, hand and fingers at all X"D