HTC Sent Me a SECRET WEAPON for Virtual Production
Рет қаралды 38,144
Күн бұрынIn this virtual production vlog I show a special piece of kit that HTC sent me to help with virtual production in the Vive Pro ecosystem. We also do an updated studio tour and look at the new Vive Virtual Camera in Cine Tracer.
Community:
Unreal Engine: Virtual Production Facebook Group: / 2456259641280347
Camera Hardware:
URSA Mini Pro G2 - amzn.to/3cvD3iC
SmallRig Rig - amzn.to/338tp14
Video Assist 12G HDR - amzn.to/2vWsMeQ
Micro BNC Cable - amzn.to/3aO3wGE
SmallRig Arm - amzn.to/3aDpADP
Computer Hardware:
Vive Pro (Base Station 2.0) - amzn.to/2I7c7I7
Vive Tracker - amzn.to/39mYnVP
Vive Base Station 2.0 - amzn.to/2PAvHRa
Blackmagic Capture Card for UE4 - amzn.to/3cpuBSf
Green Screen:
Indie Green Screen - amzn.to/2wYYLve
Indie Green Screen Connector - amzn.to/38ff7wt
Software:
Unreal Engine - www.unrealengine.com/
Cine Tracer - store.steampowered.com/app/90...
@JimmyWebs 4 жыл бұрын
We're just in the middle of choosing between in-house indy rnd, or buying complete solution. So, it's INORMOUSLY interesting for me
@CinematographyDatabase 4 жыл бұрын
which systems are on your radar?
@GhostIntheShodow 4 жыл бұрын
Informative as usual. It would be nice to see the other end of the spectrum. Gives us starter an idea of the progression path or if a project comes along, we can quickly ramp up. Keep up the good work.
@cornuArietis 4 жыл бұрын
Very Cool setup! Thank you for doing/sharing all this great information.
@arneKalypse 4 жыл бұрын
Great series. Looking forward to your comparison.
@TheMonicaProject 4 жыл бұрын
Matt, I am interested in ALL OF IT! I watch a lot of KZfaqrs but you are in a league of your own!
@LMDToolbox 4 жыл бұрын
Following you since a while with great interest. I have Cinetracer installed too. I can't wait to see the comparison between Vive and high end!
@c_f97896 4 жыл бұрын
Hey Matt! I'm a working Cinematographer here and ex techie from years back. Just a shoutout to you as I'm stuck at home for all your content and knowledge sharing. I've always been fascinated with VR back in the Mark Pesce VRML...saw him at Comdex along with a little company called Netscape exhibiting years ago. Thanks again! I'm getting up to sped on Virtual Production due to you. Stay safe!
@ChandlerWildProd 4 жыл бұрын
Loving these videos. Answering all the questions I've been having
@d3tach3d 4 жыл бұрын
The ideas for photography and filming are endless with this new movement.
@KwasnikPictures 4 жыл бұрын
your studio is AMAZING! :D
@The_Burly_Bat 3 жыл бұрын
This sounds flat out amazing!! I've read and done a lot of research about virtual still making it very interesting in the higher end tools. Hopefully you can demo some of those mechanics and share some of that information with us indie filmmakers! I'll be following along to see what you come up with! Cheers!
@TheBrhulk 4 жыл бұрын
Thanks a lot Matt, you're helping us a lot!
@AshNair26 4 жыл бұрын
Definitely interested in the high end camera tracking and LED walls
@ammodigital2939 4 жыл бұрын
Same here.
@puyakhalili 4 жыл бұрын
Yes that would be amazing
@haq765 4 жыл бұрын
same here
@JAMs6504 4 жыл бұрын
Same
@RKspadelhi 4 жыл бұрын
Yess
@lubruz7164 4 жыл бұрын
I love watching your videos! Is just amazing how the virtual production is evolving. In a close future indie filmmahers will create the most higher production level films in their garages.
@CinematographyDatabase 4 жыл бұрын
I know several filmmakers setting up indie virtual production stages in their garages right now lol.
@lubruz7164 4 жыл бұрын
Amazing! that future is here... I want to play with this new toys right now.
@fanjan7527 2 жыл бұрын
YES!!!! High end camera tracking.
@judgeworks3687 4 жыл бұрын
I like the indie path. Would be interested in seeing the differences between the indie and high end but prefer the main focus staying in the indie level as you’ve been doing. Such helpful info and videos. Thank you for making the time do. Cheers- k
@anthonymiles2302 2 жыл бұрын
Can't wait to see more on indie virtual prodcutin and gettign the most out of it.
@hoodaffairstv 4 жыл бұрын
Definitely waiting to see it
@saurabhranjan5427 4 жыл бұрын
Thanks for the video, Matt! I am starting a Virtual production setup in Mumbai. For now, I am looking at only indie level stuff but since some of my clients already want to do some heavy production work, I would definitely be interested in the high end tracking systems.
@ronzobot 4 жыл бұрын
Hey Matt great video as always! You mentioned accuracy (in tracking and lens modeling) and also tracked volume size. There's also setup time, setup cost and scaling of cost as the tracking volume gets huge. This is why, as the volumes get large, you'll see mocap systems taking over. One last point is occlusion. You're a DP and once you get all your flags and rags up there may be nothing for an optical system to see. In that case encoders may work best. Lots more as you know!
@CinematographyDatabase 4 жыл бұрын
Yeah I imagine there are quite a few different scenarios that require different techniques. I had a lengthy chat with NCam and they were telling me about their IR filtered system vs the non IR system and the other types of sensors they combine in their system.
@JavierBarrera1981 4 жыл бұрын
Thank you, Matt!!!!
@JQhardge 4 жыл бұрын
It would be super cool to see the high end stuff in action.
@JLOFlix 4 жыл бұрын
Thank you, Matt! Great presentation as always. And, YES, please, we'd LOVE to continue right up to the LED wall status! And thanks for the Facebook blog page BIG time! As far as high end tracking, are you referring to something like OptiTrack?
@CinematographyDatabase 4 жыл бұрын
Specifically Mo-Sys, NCAM, Stype. OptiTrak/Vicon are maybe, I haven't reached out to them yet. But I've used them on shoots.
@Vaynamar 4 жыл бұрын
@@CinematographyDatabase Yes that would be amazing we're hesitating between nCam and Mo-Sys for a LED wall setup - more info on the pros and cons of those systems would be GREAT! Thanks for your work Matt - it is really, really helpful.
@lucas1207 4 жыл бұрын
I’m veeery interested on how is the high end virtual production works, price, etc. I literally check if there’s new videos from Cinematography db every day, awesome work!!
@jaysutherland2623 Жыл бұрын
Good mix of info
@breadchooch6054 4 жыл бұрын
Very nice!
@SokheanJonathanOuk 4 жыл бұрын
I'm deff interested in all the flavors of every aspect of Virtual production. UE4 and tracking are the topics of what I'm interested in but I'd be interested in knowing more about the LED walls as well. Really exciting times and I can see lots of cool things that can be done with this tech.
@sandeepsajeev6048 4 жыл бұрын
Definitely interested in detailed production ready content!
@MattysEdits 4 жыл бұрын
very interested in what you were talking about at the end!
@leanperrins 4 жыл бұрын
To see the comparison between both sides would be very cool. At home I really like to fiddle around with the equiptment i have around, but on a professional set I mostly want an out of the box solution with 24/7 support. ...But...I want to get as near as it get's with my old vive.
@chrisfoley1065 4 жыл бұрын
This is great during corona
@creativehuman3d383 3 жыл бұрын
Fantastic
@GeorgesEmmanuelArnaud 4 жыл бұрын
yes Please make some review/tutorial !!
@mullinsmediaLLC 3 жыл бұрын
Thank you!! I am debating between the Canon C300 Mark iii, C500 Mark ii or Blackmagic Pro G2 for my first camera for virtual production. I would prefer autofocus but am concerned after watching your video about the C300 Mark i that the Mark iii won’t work? Any thoughts?
@mg4u4ever 4 жыл бұрын
Man. You are awesome. I have been using cine tracer for previz and it's amazing. Please please please add vr support to cine tracer so a can creat scenes from within my vr headset. And maybe you can enable recording of the vr player movment to be used as a character movement ( so i can act build the scene in vr,then become the actor and act the scene in vr then i become the cenimatographer and shoot the previz in vr) that would be a dream come true :)
@eantays7185 4 жыл бұрын
Very nice looking VP studio! I'm VERY interested to see the high end tracking system. Also how high res can Cine Tracer go and does/ will Cine Tracer have VR support similar to Unreal Engine?
@CinematographyDatabase 4 жыл бұрын
I could enable VR, but the majority of users do not have VR ready systems for Cine Tracer from what I see. People struggle with even basic maps with dynamic lighting and basic Ray Tracing, which is why I removed the old maps from the game a while back. As the user base evolves so will the system. On my machine I can load huge maps and do VR etc. it's possible.
@sinanarts 3 жыл бұрын
hey dude thx for amazing tuts. Would you advicemeto go with a ViveController or a Vive Tracker..? For realtime virtual prod.
@chfilm 4 жыл бұрын
Definitely interested in the high end tracking solutions!!
@petrsehnal7990 2 жыл бұрын
Definitely interested in comparision with high-end solution!
@EnricoGerominProd 4 жыл бұрын
Very cool as always. Would be nice to be able to map/control via USB some dmx lights linked with the 3d environment. Also something in slowmo!
@CinematographyDatabase 4 жыл бұрын
UE4 4.25 got DMX, ArtNet, and a few other protocols that I have to try out for controlling real world lights.
@vishwassavanur8185 3 жыл бұрын
It would be highly appreciated to have a series on high-end tracking and greenscreen keying technology.
@thejetshowlive 4 жыл бұрын
Wonder if HTC will release that .stl, I'd love to print it out
@jerrtinlsc 4 жыл бұрын
Hi, if I'm not shooting in 8K, can i use Atem Mini Pro for the capture card? Also, would love to know what kind of jobs Virtual productions can bring in and the prospects of it the near future. thanks!
@djdavewarren 3 жыл бұрын
i have seen some videos where people are using an iphone as a camera tracker .... do you think that the tracking will be better with the Lidar sensor on the new ipad and future iphone 12 ?
@tyldarprod1399 4 жыл бұрын
Let me show you my new studio. We have to step over the baby pen, maneuver around the walker and through the lego and rc car world. We are now there. What do you think? Thanks Matt. It looks great. That control mount looks like a wireless handheld mic clip. Hmmm. Please start with MOSYS for the high end tracking system. Hook it up man.
@CinematographyDatabase 4 жыл бұрын
that is what the rest of my house looks like
@HumbleHerman 2 жыл бұрын
PLEASE start doing the highER level pro stuff ... NOT the highest end LED walls, obviously, but the next level up from the VIVE suitable for independent features. Also, is there anything that hooks up with the 5 Xbox kinect sensors I have hanging around?
@goodenna 4 жыл бұрын
LED wall will be the future for VP, but like you said there isn't much information about it. Please show more secreat about it.
@fernsehdesign 4 жыл бұрын
hm, but what about the floor? have an LED lying flat to walk on? Otherwise YES!
@user-eg3hz3hp3s 3 жыл бұрын
Tell me please. what mount is used for the tracker? I have a hand milking tracker, how to fix it?
@dannylammy 4 жыл бұрын
Looks amazing! What kind of projects do you do with this system?
@CinematographyDatabase 4 жыл бұрын
I develop previs and virtual production tools for filmmakers (Cine Tracer), so this is a testing stage.
@reddcube 4 жыл бұрын
Looks great. Only addition is maybe the “greenroom” needs a room divider.
@CinematographyDatabase 4 жыл бұрын
B. Winky GIR!111
@letsplaychronicles9483 4 жыл бұрын
can this also be used while livestreaming? I.E. with vMix? If you have any information, please feel free to give some advice, please :)
@SOULSpot 4 жыл бұрын
You dont need a dual follow focus on the same control. The green screen subject needs to be in focus at all times for the best in engine effect anyways. Stick a vive tracker on your projection plane. Set a blueprint to control axis rotate with the tracker but only on X rotation, set the camera to be locked to the Y rotation. Attach the plane as the autofocus point or the tracker as the auto focus point in engine. Now as long as you can keep the camera in focus in real life, you should have full mobility to walk around and treat the subject as they were a real object with no fear of a vanishing point. use the second tracker you have as a virtual focus and that's what you use to control your final focus point. likely needs a second operator. I been doing this too and its a game changer.
@AshNair26 4 жыл бұрын
Hey Chris, are u aware on the ballpark costs on a LED curved wall?
@CHTFilms 3 жыл бұрын
Can it record my camera movement then apply it on a scene rendered of Unreal Engine 4/5 (for example I shoot person i real life on a green screen and this thing tracks all the movement of the camera within the shot and then apply it to add background generated in UE behind my person etc... I really need some tutorials as I am music video maker and it will be a great opportunity to level up my production. I am ready to pay if you offer this type of tutorials personally!
@hasancivili1847 4 жыл бұрын
Can I do this setup with mocap trackers in 16 camera mocap workshops? and can any dslr camera be used instead of black magic camera?
@andrewwilkins3644 4 жыл бұрын
Have you been able to get your hands on the Ncam reality setup?
@TheDavidPosada 4 жыл бұрын
definetely interested in led screen mixed reality, already own a bunch of gear and would like to get into this area of production
@Nugromant 2 жыл бұрын
Hey bro, can you talk about the PC Requirements to do nice Indie VP ?
@Zaqariyah 2 жыл бұрын
Interested in camera tracking export to use in VFX (when footage tracking is not good idea)
@iamcrisanto 4 жыл бұрын
I have a Wii Remote and Wii motion plus attachment as far as I know it has similar tracking capabilities to the Vive controller. I currently have them coneccted via bluetooth using Dolphin emulator. Could I connect my wii mote to it? That would be super cool indy production!
@LeoMaverick 3 жыл бұрын
What about Iphone vs HTC vive for tracking?
@endorfineproducties9499 4 жыл бұрын
Hi Matt, just watched a few post from you (including the hour about Cine Tracer. Great job) and curious about your new posts on the higher end tracking devices. I own a big permanent Green Screen Studio (the liimbo Green is 12mx12mx5m with full light mesh) in the netherlands and want too specialize myself in the Virtual Studio Broadcasting and mixed reality market. I think the Mo-Sys technology StarTracker is an easy too use tracking system for a permanent and "mobile" green. The also do body tracking with it. What do you think? Dont have prices yet do. Brainstorm InfinitySet together with UE4 will make it into a pro studio. But on the other end its good (and a aim) too consider "low budget" options too. Thanks for all your post. realy apriciated. Peter
@CinematographyDatabase 4 жыл бұрын
We will hopefully we showing some Mo-Sys stuff in the future, for a big professional studio you definitely want to jump right into a turn key solution for hardware and software, unless you are also a VFX/Real Time studio with tech artists/programmers etc. and can build your own. I think the Vive in the context of a professional studio is good for a smaller break off virtual scouting or virtual camera setup. That can be run by one person and doesn't require actors, unless you are putting someone in a mocap suit etc.
@jaimevives4098 4 жыл бұрын
When using the camera view, I'm scrolling to change the focal lenght, but it rotates instead. Does anyone know why?
@ClipAds 3 жыл бұрын
Vive : whats the difference between the controller and tracker?
@NiteshKumar-cs4wo 3 жыл бұрын
what if the chroma background which is 3d is replaced by 360 video. Is it possible to do it. If it is then please make tutorial about that
@GregCorson 4 жыл бұрын
Is there some place where we can buy one of these? Or did they ever release the 3d printer file for it?
@CinematographyDatabase 4 жыл бұрын
HTC released the file, it’s in the files of the Facebook group
@PlanetFrosty 4 жыл бұрын
Extremely interested in high end camera tracking.
@peterpetertorres 3 жыл бұрын
Can you flip the Vive controller upside down so you have better access to the trigger. You'll obviously have to flip it in Unreal as well but it might be a temporary solution.
@puyakhalili 4 жыл бұрын
LED wall would ba amazing to explore. Just curious if a rear projection setup would also work instead of a LED wall?
@d3tach3d 4 жыл бұрын
It should if you have a powerful enough projector with the write kiind of material.
@noahstudio3717 4 жыл бұрын
Can some one tell me the list of equipment for UE4 camera tracking please.
@collinwilkey3250 4 жыл бұрын
Do you know fi that special piece can be purchased?
@archonoff 3 жыл бұрын
Hi Matt. We're still waiting for a video about high fidelity tracking solution for indies
@adrianoufrb 4 жыл бұрын
Can we use Windows Mixed Reality instead of Vive?
@daniilkzorin5645 3 жыл бұрын
Hello. Where can i buy the "SECRET WEAPON"? Any updates?
@joelarvidsson 4 жыл бұрын
I saw a post yesterday of using the vive tracker to get a tracked "live action camera" to be able to place 3d object without the need of running a 3d tracker software. They did not demo it, and I cant find that post. But I get back on it if i do find it.
@SportandnewsProducci 4 жыл бұрын
Yes please, really interesting
@juancasacuberta1958 3 жыл бұрын
awesome mate... I want that controller clamp! where can I buy it?, is it avilable? do you know?
@juancasacuberta1958 3 жыл бұрын
or maybe where to find that file in order to print it...
@CinematographyDatabase 3 жыл бұрын
The STL is linked in the Unreal Engine Virtual Production Facebook group
@iwanhutapea8843 3 жыл бұрын
hi, im really interested in the cheapest pro system for entry level
@zzjack1426 4 жыл бұрын
Hi，matte，i have follow you so long,I Have a problem, i want to use HTC vive handle for UE4 virtual camera，if i need buy a dongle ？
@thejetshowlive 3 жыл бұрын
Hiya Matt, is there a .stl file out for this that you know of?!
@levantestream5 3 жыл бұрын
Please fríend, one tutorial of how connect htc with unreal ANd tracking camera with chrome. Use aximetry Is possible? Regards
@mrpuma141 4 жыл бұрын
does anyone know the shoulder rig he has the controller on? Thanks!
@CinematographyDatabase 4 жыл бұрын
made by Redrock Micro 🍻
@rushboardtechuk 3 жыл бұрын
It's only a shame LCD wall panels are not seamless like LED; instead having a minimal, but still very noticeable bezel. Have you considered, therefore, Transparent Colour LED Film on a black glass wall, as many are self-adhesive and would have a lifespan of 50,000hrs before replacement? Some sources are also fairly affordable for entry-level.
@GoldenPickaxe 4 жыл бұрын
Hey man, does CineTracer have support for the Steam Controller?
@CinematographyDatabase 4 жыл бұрын
Not sure, but if it's just a normal twin stick controller I would guess yes. However, it's just partial support mainly for controlling camera in real time.
@GoldenPickaxe 4 жыл бұрын
@@CinematographyDatabase Steam Controller has an analog stick and two congifurable touch pads, l/r 1/2 (with analog trigger), l/r squeeze paddles, and a gyroscope. I was just hoping anybidy had attempted using these controls, especially the gyro, for camera movement. I would presume if I bought Cinetracer on Steam I could just make a config but I'm just out of the loop
@TheWillvoss 4 жыл бұрын
Do you need a HTC vive for this to work? I see someone used the Valve Index --- Will any VR system with baystations work for this as long as UE4 compatible? I have 0 intrest in VR but I do want to do In Camera UE4 content/talent.
@CinematographyDatabase 4 жыл бұрын
You can use just a base stations and a vive controller or vive tracker. You don't technically need the headset.
@TheWillvoss 4 жыл бұрын
@@CinematographyDatabase Sir, thank you so much for doing all of this. As a VFX compositor, its something i definitely see reducing our workload, for better or for worse.. I can only imagine clients with this power in their hands, but this is the way the world is turning. You're a pioneer. Thank you very much. Looking at HL-Alyx though... i may have an interest in getting the headset... lol...
@Solovision2024 2 жыл бұрын
Do you have an example of a person using a motion capture suit with a green screen suit over it so the actor can interact with the real environment then replace green screen actor with animated character.
@iordirequena 4 жыл бұрын
Will Cinetracer work with other VR Systems? Aka Oculus
@CinematographyDatabase 4 жыл бұрын
Right now only Vive and Index.
@luisjavier1781 3 жыл бұрын
88/5000 hello, excellent video. Where can I download the STL for mounting the HTC control
@sinanarts Жыл бұрын
Never Answers 🙂
@dothefilmTV 4 жыл бұрын
we used some highend systems, most of the time it's around 30k$
@CinematographyDatabase 4 жыл бұрын
nice, what systems have you used?
@dothefilmTV 4 жыл бұрын
@@CinematographyDatabase halidefx one, actually we are in talk with mosys
@CinematographyDatabase 4 жыл бұрын
@@dothefilmTV very cool, I know the Halide dev and I used their older Previzion Lightcraft system. I've chatted with MoSys is well, hopefully we can show their system later this year.
@miguelbenitezparga1368 3 жыл бұрын
hello how can i contact you
@gregmar7469 3 жыл бұрын
Would you be interested in partnering with us to produce a full 180deg LED back wall Mixed reality demo? We have a very large inventory of 2.5mm LED panels and multiple warehouse locations in US and Canada. We are very interested in this industry.
@westleyleonstudios 4 жыл бұрын
Is that just a Microphone clamp?? That's what it looks like.
@CinematographyDatabase 4 жыл бұрын
it basically is, but it's specifically formed to the Vive Motion Controller and designed to keep it in a very particular angle. Using a clamp or bongo ties etc. works but it's never perfectly level.
@wstolk 4 жыл бұрын
@@CinematographyDatabase Is there any news or possibility of Vive releasing this clip file or someone making it? It looks so much safer than the clamp setup
@rodelioferrer6187 3 жыл бұрын
I havent learned anything from what you said
Eater Straw Hat
Рет қаралды 16 МЛН
Jacques Crafford
Рет қаралды 321 М.
Jon Jags Nee
Рет қаралды 10 М.
The Granary
Рет қаралды 70 М.
КИНОВИЗОР
Рет қаралды 4,4 МЛН
Нарезки из фильмов
Рет қаралды 4,3 МЛН