Is iPhone Motion Capture Ready for Production? Move.AI or Xsens

  Рет қаралды 24,429

Unreal Han

Unreal Han

Күн бұрын

Download a 30-Day free trial of Polygonflow here: cutt.ly/p8L8WHV
--------------------
Finally decided to do a comprehensive in-depth review about Move.ai system directly compared against Xsens. I ran through some really challenging scenarios for both systems like rolling, fast motion, and subtle motion to see which one comes out on top. Hope to help you make a more informed choice picking the best one for you!
Download the fbx data here:
bit.ly/40av9Dd
(this is pre-retarget data, you will need to retarget yourself to the rig)
--------------------
Twitter: / hanyang_vfx
Insta: / unreal_hany
Artstaion: www.artstation.com/hanyang
00:00 Introduction
01:15 PolygonFlow
01:50 Benchmark
02:07 Price
03:42 Space+shooting
05:43 Data Comparison
07:38 Verdict

Пікірлер: 81
@Unrealhan
@Unrealhan Жыл бұрын
Which mocap are you using?
@MR3DDev
@MR3DDev Жыл бұрын
Perception Neuron, but I am going to give Deepmotion a shot.
@Unrealhan
@Unrealhan Жыл бұрын
@@MR3DDev curious to know how they compare to xsens or rokoko
@MR3DDev
@MR3DDev Жыл бұрын
@@Unrealhan Is easier setup than xsens (also no subscription fee) but the hand capturing is not good. Rokoko was pretty janky but I tested it in 2018 so it may be different now.
@Megasteakman
@Megasteakman Жыл бұрын
Awesome look at this! I was tempted to look into move, but I think I will stick with my Unreal Engine Vive Tracker solution for the time being.
@m1sterv1sual
@m1sterv1sual Жыл бұрын
Rokoko but soon going on Xsens
@landonp629
@landonp629 Жыл бұрын
$4,000 for 6 iPhones? Why? You can get used iPhone 11's for like $200 a pop. Maybe $1,200 on the high end.
@IamSH1VA
@IamSH1VA Жыл бұрын
~$50 Webcams also works well, don’t need to spend $200 for iPhone.
@landonp629
@landonp629 Жыл бұрын
Another issue I have is your testing method. You are wearing baggy clothing without much contrast, which will also reduce the accuracy of the tracker. I use Move AI in a well-lite studio space with white walls, and the talent each wearing body-snug bright colored suits. Haven't had any real issue. I think too many people assume this is TOO casual of a method for capturing mocap data - you need to treat the studio space like you would a $50,000 IR tracking system, not like you would an inertia-based suit workflow.
@FinalGrade
@FinalGrade Жыл бұрын
Spot on. Exactly. Its a camera based design. Also Xsens requires subscription too from what I can see. And if you want unlimited processing minutes it $250 a month. Pretty crazy. MoveAI also lets you use Iphone 8 instead for cheaper cameras or just use experimental mode and use different cameras entirely. Some guy in the moveai discord had these $25 cameras that fit the specifications by Moveai and had four set up getting great results.
@bovineox1111
@bovineox1111 11 ай бұрын
​@@FinalGradeI'm going to give this a go with some cheapish 1080p 60fps action cams
@Chainism
@Chainism 7 ай бұрын
This was so well filmed, edited, narrated, and researched. Subscribed. Keep up the amazing work, you'll definitely take off buddy!
@robertturaa9561
@robertturaa9561 4 ай бұрын
It's funny that people complained about the pricing of this mocap (from what I understand you are talking about the multi-cam option) NOW it's not $365 a year but $5,000 a year and not 30 minutes a month but 20 minutes a month. And the one camera option is also still more expensive than that full multi-camera plan was. I just paid $20 for a 1 month access of 3 minutes processing time. I was so hyped back then to try it out but I didn't have access to an iPhone... I finally got to borrow one or two but now I'm screwed again, this time by the pricing policy :(
@cecka
@cecka Жыл бұрын
Great summary and initial review - looking forward to hear more about this in the future.
@FinalGrade
@FinalGrade Жыл бұрын
I put moveai with a period and youtube auto deleted it. Fantastic. Well lets try again. First off thank you for this video and information! I have to disagree however for the following points: 1. You can spend way less on a Iphone 8 or even different cameras entirely. In experimental mode you can use any camera that fits the right specs. A guy got it working with $25 cameras. Moveai even started out with GoPros before Iphones. 2. The 30 minute cap seems bad but then you realize that Xsens does the same thing unless you pay $250 a month for unlimited processing. A MONTH! And thats after buying the suit. 3. Want to add another person with xsens? Well now you need another expensive suit. Or you have to record again separately and hope the animation syncs. 4. Suiting up every single time with multiple actors can be a headache. I still think the price bracket Xsens wants is not comparable to moveai. It is much cheaper still to use moveai. Unless there is a way to process unlimited data with Xsens that is free I don't see how it is better if it has that same subscription issue with an even higher barrier of entry.
@samgoldwater
@samgoldwater Жыл бұрын
Fantastic elucidation of where these tools are at, thank you Han! 😎🥳🏆
@knowyourfortune
@knowyourfortune Жыл бұрын
It’s nice to see your channel going so well!
@remcosikkema
@remcosikkema Жыл бұрын
Thank you for the fair comparison, it really shows the strong and weak points of both systems. This information will for sure help those checking out different options, I would surely recommend they watch this video to get a good overview.
@TrashPraxis
@TrashPraxis Жыл бұрын
Nice video! I was thinking to do this kind of video +optical but can't seem to get to it. Thanks for including the floor rolling and hands on surface, great to see how it does in these situations
@lemmonsinmyeyes
@lemmonsinmyeyes Жыл бұрын
This is awesome, thank you for the direct comparison!
@gabrielkuklinski9806
@gabrielkuklinski9806 Жыл бұрын
Han, I'm just addicted to your videos mate, I NEED A FULL COURSE OF YOURS SOON! any plans on doing it? Maybe a filmming master course or something? Cheers and always thank you for the amazing content!
@edcelmendoza9161
@edcelmendoza9161 Жыл бұрын
Thank you for sharing and explaining Han!
@cpsstudios
@cpsstudios Жыл бұрын
Needed that review, Thank you!!
@entertainmentbilly2231
@entertainmentbilly2231 Жыл бұрын
An update would be welcome. Now there is monthly payment option and experimental mode, which works with all sort of footages from any camera.
@EnterMyDreams
@EnterMyDreams Жыл бұрын
I love your content! Great breakdown, thank you so much
@emo10001
@emo10001 Жыл бұрын
This is super helpful. Thank you for an honest and comprehensive review with your OWN testing and data. Definitely a sub from me. I've got a Perception Neuron v32 which still works well for me. Markerless mocap at an affordable price with good fidelity...just doesn't quiiiite seem to be there ....yet
@mocappys
@mocappys Жыл бұрын
Great video, Han. Really interesting to see a comparison of the 2 systems. One of the keys to getting the most out of any mocap system is knowing exactly what it can and can’t do so you can plan round it, so this is really useful. I always find the claim “you don’t need a suit” a little cheeky. While you don’t need to wear a Lycra suit, you do need clothing that contrasts with the surroundings and the different parts of your body to improve tracking.
@Unrealhan
@Unrealhan Жыл бұрын
Agreed. Tricky part is it’s ai, so we just all guessing what will work best including clothing.
@mocappys
@mocappys Жыл бұрын
@@Unrealhan yeah, it’s a shame the software can’t do a quick preview to give you some idea if it’s worked or not, a bit like raw marker/sensor data in other software. It’s the not knowing if it’s worked that’s a bit of a deal breaker for some.
@Kidultchar
@Kidultchar Жыл бұрын
It's true that it's too expensive, but for amateur creators like me, there is no alternative other than move ai. I wish there was a monthly subscription plan.
@Xashadowin
@Xashadowin Жыл бұрын
Really nice comparison. Let just add to that the fact that mostly... everyone has a phone capable of doing that. We tried it in our studio and if you combine someones phone + tablet, you end up pretty fast at the number of devices needed for the capture. In our test I just borrowed someones iPhone + my own + my other friends phone in the test and finally my ipad. We ended up with four devices at a total cost of... 0$. Which cuts the cost then to "only" the tracking fees. But for the accuracy and everything in this video thanks for comparing the exact same motion with two different technics! It's still super impressive for a tech that can be used by anyone!
@yodojo3493
@yodojo3493 10 ай бұрын
Body Occlusion with 6 cameras! lol Great video!
@renbry
@renbry Жыл бұрын
Thanks for the comparison and a very fair review. It was certainly eye opening when I got into Mocap via XSens Awinda a few years ago. Understanding that although there's a single term for this ("Mocap") there's actually so many subtle differences that one ought to understand - some you spoke of such as the volume where inertial suits can run loose in the wild vs in a volume. Some others that I had to learn the hard way : Do you want Live streamed mocap or just offline recordings? Do you want really, flawless mocap done Live or Offline? Two or more people touching with great registration between them? Props? Camera tracking? Visibility of the Mocap suit to a camera that may be filming? So many of these questions I didn't know i needed to ask but had to discover along the way. We've since gone with OptiTrack for great Live/Offline recording, multiple person registration, Props and Camera tracking although recently we were asked to do recording mocap of people wearing high fashion clothing - so the XSens came out of the cupboard because we could hide the sensors ! It's a wonderful thing but gee, was it expensive learning all these points! Thank you for helping the community understand more about the topic!
@riretf
@riretf 3 ай бұрын
What sensor did xsens use? Is it mti-G710?
@ahmeterkoc9502
@ahmeterkoc9502 Жыл бұрын
What about finger? Is it good enough?
@yiiarts6641
@yiiarts6641 Жыл бұрын
Thx for your efforts mate. Can you also make a comparison video of xsense and rokoko? That would be great.
@Unrealhan
@Unrealhan Жыл бұрын
Get Xsens if you can. Rokoko can’t beat it not even close.
@lovelearn341
@lovelearn341 Жыл бұрын
Cool video! I see you mostly do your animations in unreal engine. And I have a question. How many poligons does your rigged model have? As I can see, it's done very well. I personally rig models in blender. Although they are great in LOD0. Blender can't let it move or render smoothly. Although I have a powerful computer. And it seems to be very smooth in unreal engine. Can you give tips if I need to know something about a UE model beforehand...
@naq_montages
@naq_montages Жыл бұрын
0:32 It would be so cool if you could give us some tips on filming two characters fighting while having only one motion capture suit
@Unrealhan
@Unrealhan Жыл бұрын
Good point. Will put on the list!
@FinalGrade
@FinalGrade Жыл бұрын
@@Unrealhan I second this! Would love to see your workflow on that!
@wadekettell2626
@wadekettell2626 Жыл бұрын
Good Review
@GarrethDean1
@GarrethDean1 4 ай бұрын
+1 SUB ! I have been looking for a great KZfaqr that talks about retargeting in maya. The most daunting thing as a solo indie dev is character rigging + animating and retargeting. I have not gotten it working proper. Anyway, Great video! I was looking at Rokoko and an Iphone system. I think Rokoko is the way to go
@anthonyganjou2485
@anthonyganjou2485 Жыл бұрын
Han thanks for the objective review. We’d welcome your thoughts on what a more viable free trial period might be alongside the minute allocation monthly. Also if you want to do more tests pls do reach out and we can facilitate more credits for you to continue to explore. Totally hear you on the connectivity issues two weeks out from launch we are still ironing out some gremlins from the system and making it much more robust. Just to confirm you are testing this against the MVN link which costs $12,000 and software which costs $5,000-10,000 pr/yr? If so it’s a thrill to see the data come out so closely comparable. Sorry you had to shoot in the rain but loads of people are shooting in much tighter spaces indoors using the wide angle lens on the 11 up. The hardware on a system like this can run as little as $1300 if you are buying refurbished iPhone 11s.
@Unrealhan
@Unrealhan Жыл бұрын
Yes the benchmark is MVN link, not a cheap suit for sure and I understand not everyone has access to system like that. MoveAI does present an alternative for sure. Good to know there's room for extra minutes for testing etc. I think the trial period should be 10 mins (i think it's 5 for beta users?). That should give ppl enough time to trouble shoot the equipment and run some actual test in different settings and environments. They probably already purchased the iPhones so most likely they will commit. In terms of monthly allocation, personally i would prefer a monthly subscription instead of annual. Reason being I only use mocap for the first half of a project (shooting and previs), not every month. So depends on each user case maybe the quota will vary but I think an average 30mins/month is not too flexible. I'm curious to know what the community thinks too, as it varies case by case. Love to hear what your road map is in terms of the data quality too, AI develops so fast you guys probably already working on some cool stuff 😉
@PeteD
@PeteD Жыл бұрын
If you can decouple the processing from the export, that will open up some options. Allow users to test footage recording conditions/variables/workflow but limit how much they can actually export
@anthonyganjou2485
@anthonyganjou2485 Жыл бұрын
@@PeteD appreciate your feedback thank you.
@ArthurBaum
@ArthurBaum Жыл бұрын
Very glad that somebody finally has a more critical view on that software solution. After two months of using it I gotta say they definitely hit the right direction but the execution is far from perfect. The most frustrating thing for me are the restrictions of the app: 1. You can't upload individual files, only all or none. 2. they have deactivated the function to share the raw recorded videos from the iPhones to other devices. 3. Wouldn't be that much of a problem but unfortunately the app is prone to crash when uploading a lot of takes (which is normal on long production days). The older the iPhone is the worse the problem gets. So, that's why their USP of cost-efficient productions is kind of invalid. Ultimately you end up buying or renting expensive iPhone models.
@Unrealhan
@Unrealhan Жыл бұрын
Very good point. User experience def more to be desired. The app literally is just doing recording, should be able to let us access raw files.
@ArthurBaum
@ArthurBaum Жыл бұрын
@@Unrealhan You CAN ask the support for individual access to this function. Though that doesn't solve the problem of the app constantly crashing on uploads, especially on older models. It has something to do with bad memory management. The Devs know about this problem. Though they are still trying to push the narrative that only need iPhone 8s in order to do unlimited MoCap.
@anthonyganjou2485
@anthonyganjou2485 Жыл бұрын
@@ArthurBaum working really hard on fixing all these problems as you know. We are only three weeks in from launch so should all be fixed and these gremlins solved in the next couple of weeks. Also appreciate your feedback on the functionality reviewing this too
@FinalGrade
@FinalGrade Жыл бұрын
@@ArthurBaum You can actually go cheaper than iphone 8. A guy in the discord setup $25 cameras that fit within spec and ran 4 of them with great results. I don't know much about the connectivity issues you are having but seems like a pretty fantastic alternative to a $12000 mocap suit and $250 a month sub to motioncloud.
@gladiyit6771
@gladiyit6771 Жыл бұрын
ty
@jackdouglass1667
@jackdouglass1667 3 ай бұрын
of course, its raining on the day when you booked everything out
@DaveK183
@DaveK183 Жыл бұрын
Hmm, just checked all options for this budget motion capture and I'm very disappointed (nothing against Move tho). My main question is, how are VR googles so cheap, when you track the headset, and several controllers with perfect precision? It can do it for less than 1000 bucks, and you have a VR headset next to it? I would so much like some explanation.. thanks.
@MR3DDev
@MR3DDev Жыл бұрын
30 minutes a month? Geez I got hours of mocap data for my 10 minute short film. These monetization methods are not good.
@FolkerHQ
@FolkerHQ Жыл бұрын
it could be cheaper to rig and animate it by yourself 🙂 or ... have a look into iPi Recorder (ipisoft)
@johndoe-cd9vt
@johndoe-cd9vt Жыл бұрын
is it better to use vive trackers
@anthonyganjou2485
@anthonyganjou2485 Жыл бұрын
The data quality isn’t remotely comparable
@shataluproductions
@shataluproductions Жыл бұрын
@@anthonyganjou2485 in what way? Better or worse?
@dannylammy
@dannylammy 5 ай бұрын
In my honest opinion after having tried it: nah.
@prasoondhapola2875
@prasoondhapola2875 Жыл бұрын
I think if wonder studio turns out to be as good as they claim, these existing solutions won't stay relevant much longer. Be it mov ai or mocap suits
@Unrealhan
@Unrealhan Жыл бұрын
I think wonder studio utilize similar tech only single camera based. I remain skeptical about how polished they are until someone test it.
@user-jc5qx9og6i
@user-jc5qx9og6i Жыл бұрын
是你吗 我还买了你在翼虎的课程呢
@cj5787
@cj5787 Жыл бұрын
uhm.... so 365 USD for something you wouldn't use during the whole year with the lie of being $1 day price, but on top of that you only get 30min per month.....
@lotusfilm1
@lotusfilm1 Жыл бұрын
MoveAi only for who is learning about animation and mocap
@birdonfiremedia
@birdonfiremedia Жыл бұрын
There's a few AAA studios who would disagree with you there. It's still being refined and improved, but it out-performed my Awinda Starter in my tests (without a 10K p/a Xsens Pro subscription, I ran into issues with the Xsens drifting that move doesnt give me, so cleanup is at least consistent)
@FinalGrade
@FinalGrade Жыл бұрын
Disagree. Get creative with your mocap and telling a story. Be very specific about what you need an when. Once you do that it has a professional place to be used. Its just another tool. Cant afford crazy xsens prices? Well then you use moveai. That simple.
@mick3d293
@mick3d293 Жыл бұрын
Honestly you failed to research proper clothing and contrast. You mean well, but it is a misleading video. You should try again with different clothing
@UHHPIA
@UHHPIA 4 күн бұрын
jesus christ loves you all
AI Motion Capture with just a Webcam? Rokoko Vision
8:56
Nils Gallist
Рет қаралды 897
PERFECT MoCap with 1 iPhone! (Move One)
3:07
CoPilot Virtual Production
Рет қаралды 29 М.
Looks realistic #tiktok
00:22
Анастасия Тарасова
Рет қаралды 104 МЛН
БОЛЬШОЙ ПЕТУШОК #shorts
00:21
Паша Осадчий
Рет қаралды 11 МЛН
Move Ai | Complete Guide to Getting Setup
19:08
WINBUSH
Рет қаралды 22 М.
The BEST Motion Capture Suit for 3D Animation | 2023 Comparison
15:58
Daydream Studios
Рет қаралды 21 М.
I wasted $4000 on a Rokoko Mocap Suit
15:29
Moon
Рет қаралды 64 М.
8 Best Motion Capture Software
11:25
InspirationTuts
Рет қаралды 66 М.
Virtual Production at Home with an iPhone and TV - Unreal Engine
11:17
I Made The SMALLEST Virtual Production Studio!
7:58
Joshua M Kerr
Рет қаралды 78 М.
The Future of Facial Animation with AI | Unreal Engine Metahuman
11:36
THIS IS HUGE! Everyone can do High Quality Face Mocap now!
9:04
Cinecom.net
Рет қаралды 314 М.
They Were Not Ready For This ‼️
1:01
Urban Street +254
Рет қаралды 9 МЛН
чёт жутковато стало☠️
0:20
𝓢𝓾𝓰𝓪𝓻ℂ𝔸𝕏𝔸ℙ𝕆𝕂_Sasha
Рет қаралды 2,5 МЛН