Mocap from your Phone for FREE - AI-based motion capture technology

Рет қаралды 68,681

Күн бұрын

Today we'll be looking at Rokoko Video, the free app that allows you to motion capture directly from video. We'll record some motion from a phone and see what kind of mocap results we can get for our 3D characters.
Try the app here: rokoko.co/CGshortcuts
And download Rokoko Studio here to export your mocap animation to Cinema 4D: www.rokoko.com/products/studio
Also mentioned: www.mixamo.com/
❓❓❓Have a CINEMA 4D Question?
Ask it below or contact us here: cgshortcuts.com/help
👉👉👉 Become a CG SHORTCUTS MEMBER and get access to Pro Training, Time-Saving Project Files, Courses, C4D Support & more - cgshortcuts.com/membership
Now also available on Patreon: link.cgshortcuts.com/Patreon
CG Shortcuts with Dave Bergin - Learn Cinema 4D Faster.
--------------------------------------------------------------------------------------------------------
⬇⬇⬇⬇⬇⬇⬇👇 Get your FREE REDSHIFT RENDER CHECKLIST & TUTORIAL! 👇 ⬇⬇⬇⬇⬇⬇
Learn how to render faster and smarter every time ➜ cgshortcuts.com/redshift
--------------------------------------------------------------------------------------------------------
⭐Want to learn OCTANE?⭐
Try our Octane Masterclass - NOW INCLUDED WITH MEMBERSHIP
⭐ Available here ➜ cgshortcuts.com/octane-master...
--------------------------------------------------------------------------------------------------------
⭐Want to learn REDSHIFT?⭐
Try our Redshift Masterclass - NOW INCLUDED WITH MEMBERSHIP
⭐ Available here ➜ cgshortcuts.com/redshift-mast...
------------------------------------------------------------------------------------------------------------
⭐ We render all of our projects on Drop & Render Farm for Cinema 4D
- GET €10 RENDER CREDITS HERE ➜ link.cgshortcuts.com/dropandr...
------------------------------------------------------------------------------------------------------------
💻 Get more tutorials and resources on our website!
www.cgshortcuts.com
🎓Find our courses at CG Shortcuts Courses
www.cgshortcuts.net
😃 To share your work with the CG Community you can post on the Facebook group, would love to see what you've made with the tutorials! Join here: link.cgshortcuts.com/Facebook...
👉 Get More Videos and Free Stuff - Subscribe ➜ link.cgshortcuts.com/KZfaqC...
Ask us a question or let me know what you want to see next in the comments section below!
▼ FOLLOW US ▼
⭐ Website: www.cgshortcuts.com
❤ Patreon: / cgshortcuts
🎓 Courses: www.cgshortcuts.net
😃 Facebook: / cgshortcuts
📸 Instagram: / cgshortcuts
❌ X (Twitter): / cgshortcuts
00:00 Introduction
00:13 Rokoko Video Into
05:01 Import to C4D
08:10 Mixamo workflow
10:27 Outro
#CGShortcuts #Cinema4D #C4D

Пікірлер: 101

@CGShortcuts Жыл бұрын

Try the app here: rokoko.co/CGshortcuts And download Rokoko Studio here to export your mocap animation to Cinema 4D: www.rokoko.com/products/studio

@smileyaliona Жыл бұрын

So cool!

@infojaviernova Жыл бұрын

Wow! This tuturial, is pure gold, thank you very much, :)

@CGShortcuts Жыл бұрын

Glad it was helpful! Did you give that app a try?

@hihihing7302 Жыл бұрын

Thanks as always!

@CGShortcuts Жыл бұрын

My pleasure!

@i65Design Жыл бұрын

Excellent tutorial. A most interesting tool. AI tools for mocap are popping up all over the place now! Change is happening faster that we can adjust to a 'current' offering!

@CGShortcuts Жыл бұрын

Very true, AI everywhere all of a sudden. If it saves time I'm all for it

@sophialiarou4688 Жыл бұрын

AMAZING!!!!!!

@CGShortcuts Жыл бұрын

its good fun isnt it!

@optimus6858 Жыл бұрын

GOLD

@CGShortcuts Жыл бұрын

Cheer Optimus!

@delsings Жыл бұрын

Thank you for this!

@CGShortcuts Жыл бұрын

No problem Del, If you give it a try let us know what you think!

@delsings Жыл бұрын

@@CGShortcuts sure thing! I'm trying to figure out all aspects right now so may be a while XD (My brain wants to move from mo cap right to a custom model to apply it to lol)

@vasily3994 Жыл бұрын

extremly useful.🤙🤙🙏🙏

@CGShortcuts Жыл бұрын

Cheers Axel!

@iamYork_ Жыл бұрын

I finally acquire a lidar cam and this releases hahaha... story of my life...

@CGShortcuts Жыл бұрын

haha, always the way isnt it!

@chadgtr34 Жыл бұрын

lidar cam is probably more accurate, this video doesn't answer to 'high speed running ' mocap though.

@mnl8286 Жыл бұрын

不知道你是否可以翻译中文，但是我真的非常喜欢你的视频，每次都能带来不一样的惊喜！

@davebergin7987 Жыл бұрын

感谢您的评论，很高兴听到！更多视频正在制作中！

@CGShortcuts Жыл бұрын

@halfcalf72 9 ай бұрын

This was excellent. Thank you. I am looking at a way to get MoCap without the suit. I looked at MoveAI and Rokoko and this Rokoko workflow resonates better with me. Do you find it easier? also, my office is small where my computer's webcam is. I will have to take short clips of several action takes in order to blend the mocap together in c4d...?

@CGShortcuts 9 ай бұрын

Cheers, I never tried MoveAI in the end, was turned off by the fact that I needed several iPhones (not sure if thats still the case) and the extra space. Rokoko has been around for ages and have solid workflows and software so it should be a good bet

@EZZYLAND Жыл бұрын

this is it. we dont need mocap suits anymore. the AI present is here

@CGShortcuts Жыл бұрын

Its definitely exciting times!

@matteo.grossi Жыл бұрын

lol

@EZZYLAND Жыл бұрын

could we pls get a unreal engine workflow! also will i be able to use livelink (face mocap AI app) in conjunction with rokoko video?

@CGShortcuts Жыл бұрын

I think an Unreal Workflow tutorial is a great idea! I'll add it to the list! - If you can get the Livelink dat into C4D I dont see why not

@watchandproduce Жыл бұрын

It would be great to see this workflow in Blender as well.

@CGShortcuts Жыл бұрын

Sorry Mark, we dont use Blender

@bogscave 11 ай бұрын

@@CGShortcuts and thank you for that, my hobby would not exist without you guys 🤍

@oblivion1501 Жыл бұрын

Great stuff! However, is it possible to extract the posing from just a picture instead of a video in rokoko studio? I guess most probably not, but then what would be the ideal way to do it?

@CGShortcuts Жыл бұрын

I think it only accept video files. Just record yourself making the pose or try exporting your still as a video and see what happens

@extrathicc78 11 ай бұрын

any follow up on this? did you try exporting a still image as a video to extract a pose?

@chadgtr34 Жыл бұрын

does it do well with the scane ' a women walking very fast on high heel ' ?

@CGShortcuts Жыл бұрын

Not sure, I didnt try it with high heels on;)

@samuelosborn2548 8 ай бұрын

do the fingers move at all? or do you have to do some finagling to make that happen?

@CGShortcuts 8 ай бұрын

It doesnt capture finger movements, you'd need the suit for that

@DeepMotionInc Жыл бұрын

We'd love to know what you think about DeepMotion - we have Hand & Face Tracking available with Multi-Person coming soon!

@CGShortcuts Жыл бұрын

Havnt heard of it, is it similar? Better results?

@DeepMotionInc Жыл бұрын

@@CGShortcuts Definitely better results -We've been working on ours for a lot longer and offer many more features (Face & Hand Tracking) than Rokoko. We have free accounts, and would love to know what you think!

@philippeLebret Жыл бұрын

Great, but how to update that process with facial rig for more options ? :p

@CGShortcuts Жыл бұрын

You could probably blend it with Moves by Maxon for the facial animation part: www.maxon.net/en/cinema-4d/features/moves-by-maxon

@eberlekim8763 5 ай бұрын

Hey there, very nice Video thanks a lot! Quick question: I am working as a GameDev & currently looking for the best and most efficient way to make many different animations and clothing options for my character. I thought about rigging my charcacter with the same skeleton scructure that Rokoko will export the animation data. Then I dont have to retarget & instead just copy/paste the keyframes of the bones. At least I think so haha. Then I need just a way to make a own control rig out of the skeleton the make some own animations if I want to. And also i got to find a way to weightpaint & parent the new clothings to the skeleton if i make new ones. Do you have any thoughts about that? Sorry for all these questions, I hope I dont bother you :) I''ll be very thankul for every response, have a great day!

@CGShortcuts 5 ай бұрын

Rigging is a pretty complex topic, are you planning to do it all in Cinema 4D? A combination of motion capture and keyframing by hand is usually the way, but it sounds like you know what you need to do. Realy depends on how detailed you want to get (considering budget and time restraints)

@MadDogHatesWoke Жыл бұрын

is the unreal skeleton in the app settings unreal 4 or 5 skeleton?

@CGShortcuts Жыл бұрын

No t sure, we dont use unreal

@macitseferi1843 Жыл бұрын

Does the software allow me to use more than one camera to get better quality results?

@CGShortcuts Жыл бұрын

I dont think so, not at the time we tried it amyway

@MegaBexon Жыл бұрын

Omg we have a same tummy. Let's blame C4D :)

@CGShortcuts Жыл бұрын

Yep, the more I use C4D the more 3D my belly becomes!

@gladmerchshop Жыл бұрын

how can i export it like an mp4 without a background and put the avatar besides me ?

@CGShortcuts Жыл бұрын

Export it as a PNG sequence with an Alpha Channel then comp it into footage of yourself

@percyrogers7246 Жыл бұрын

Not really that good of an app but it works somewhat. The recordings are not even accurate but it slightly picks up what you did.im going to just wait for an update for it to get more accurate with video's cause right now my options is only do it live for a small price.

@CGShortcuts Жыл бұрын

Early days for the sofware, it should only get better, still pretty impressive I thought

@percyrogers7246 Жыл бұрын

@@CGShortcuts agreed! it is pretty neat, but hopefully it gets better with detecting the body.

@davidguerrero9706 Жыл бұрын

Have you used maxon's move? Do you think its better option? especially if you use c4d.

@CGShortcuts Жыл бұрын

Hi David, I would love too but I dont have an iPhone!

@Kondi_Animation 9 ай бұрын

Can I do that in C4D lite?

@CGShortcuts 9 ай бұрын

Doubt it

@ladybugcatnoirfangirl65 2 ай бұрын

Say if i want to get a dance from a video can I do that too

@CGShortcuts 2 ай бұрын

I dont see why not

@mufasa2079 Жыл бұрын

The camrera has to be low enough so that it doesnt look like you are on your tippy toes

@CGShortcuts Жыл бұрын

You might be right there Mufasa, I just whacked it on my tripod

@randyharris882 8 ай бұрын

Does this work with Daz studio?

@CGShortcuts 8 ай бұрын

Not sure, I'd only use Daz for character creation, would rather handle the animation in c4d

@oxhid3 4 ай бұрын

now it feels it is not free anymore, I am asked to upgrade plan to export

@CGShortcuts 4 ай бұрын

No way, really. Thats a shame, I thought it was meant to be free forever

@rohilabrar5708 Жыл бұрын

What about facial it's work on facial too

@CGShortcuts Жыл бұрын

No face or fingers yet, but we'll do videos about how to do that soon

@parapoliticos52 7 ай бұрын

I dont get it why it is not possible to make an affordable motion suit. Why would be any different that the VR avatars generated using the handles.

@CGShortcuts 7 ай бұрын

They have definitely come down a lot in price over the years

@barba3377 Жыл бұрын

are there ways to actually improve the results? for example wearing a specific color, using a green screen ecc.?

@CGShortcuts Жыл бұрын

not in my testing. angling the camera as straight as you can to the subject does help though, dont shoot from slightly below or above

@randomdudr Жыл бұрын

Green screen may make it worse IMHO. Unless you make the ground a different color. Just my opinion though

@anything_x 8 ай бұрын

Yea, just upload your videos

@CGShortcuts 8 ай бұрын

Not sure what you mean

@user-pu5yy6pu9v Жыл бұрын

cant work with ue5?

@CGShortcuts Жыл бұрын

Im pretty sure it does, just need to export it in the right format;)

@avesia4678 Жыл бұрын

Not works for mobile. Choosing existing video not loading lol

@CGShortcuts Жыл бұрын

I think I just shot the videos on my phone and transferred them to desktop

@Coonestapes 4 ай бұрын

Okay but how do i do it from my phone

@CGShortcuts 4 ай бұрын

the phone part is just taking a video of yourself. I just connected the phone to the pc and uploaded the video from there

@ApexArtistX 10 ай бұрын

Why does American free always has a limit

@CGShortcuts 10 ай бұрын

Because they're a business and it costs money to develop such tools

@TamOlyn Жыл бұрын

Oh come on, It's not FREE If you have to PAY FOR IT.

@CGShortcuts Жыл бұрын

Rokoko Video is FREE, their other stuff is paid

@DirectionGaming 7 ай бұрын

No Fingers

@CGShortcuts 7 ай бұрын

unfortunately not

@Keji839 Жыл бұрын

AI needs work This is nowhere ready for production workflows. I’ll stick to IPIsoft mocap with 2 Xbox kinects

@CGShortcuts Жыл бұрын

I think its definitely the best AI mocap out there, plus Rokoko plan to develop it further so hopefully it'll only get better - was good fun playing around with it though!

@EZZYLAND Жыл бұрын

AI improves at exponential speeds lol humans dont

@Keji839 Жыл бұрын

You are both very correct

@WillyCash69 2 ай бұрын

Funny how all videos showing motion captures like this, strategically choose Characters that have no face or its covered with a mask so you cant see the major flaws it.

@CGShortcuts 2 ай бұрын

It doesn't track facial features so it's not really necessary.