Matt this is AWESOME. You are getting close and I can see that inspiration you were feeling. Its getting close to the point where you can make something that looks pretty damn amazing with Virtual Production and UE.

This is looking great! So cool to see you spin this up so quickly.

So awesome to follow your journey and see it all coming together now!

Great result, Matt. Thank you for your videos!

It's exciting to see your tests with virtual production, Matt. This sort of thing would have cost a fortune 10 years ago. Imagine how cool it will be when you can get one of those big LED walls!

FANTASTIC! Thanks SO MUCH, MATT!! TRULY motivating!

This is amazing. Thank you so much for sharing your process.

OMG this is so insane!!! This changes cg so much

So awesome!! Thank you...I really loved your explanation and demo of the composite:)

well done m8. always difficult to try something new when there is no youtube tutorials on the subject. looks great

Wow ... Tech has come a long way Brilliant ... Now keep that AVR (Augmented Virtual Reality) as Ur standard background 👏👏👏

Looks great. You are inspiring me to shot the short with your technics. Thx!

This is so dope! Thank you for making these videos!!

I love your work so much !! Looking forward to a new enhance version of CineTracer with character blocking and staging system, mark their movement.

I watched that video demo with the guy on the motorcycle using Quexil assets and the led walls with the tracked cameras over 20 times showing all my friends and family how mind blowing it is that we are now to this point. Now that I found your channel im really glad I did because Ive been wanting to know more

"Hit stop, give the media to the Downloader, who is me in my case, err" lol amazing work!

Well done!! 👏🏽👏🏽👏🏽

Gee Matt you’ve come a long way in a short time. That is unbelievably amazing. I would love to see this in person. Any plans for workshops once we are free from the pandemic? BTW I’m finally going to be able to get the RTX 2080 Ti so I can finally get to work with Cine tracer. Love your work man!!!

Ooh. Wow. Maybe Ian Hubert wants to look at this! Because this is Soo cool!

You are awesome Matt!!

Bro, thanks for sharing your rig, it's look really amazing!! Keep posting videos about it please!

Nice you got the live key to get good results.

This is incredible

Thanks for sharing. Great job!

amazing bro, keep it up !!

LOL, your equipment is godlike compared to mine. I am using a Canon T5I and a T6S, but I am getting similar quality results. UE4 Production is the future man. I feel like a pioneer on a new frontier.

Bruh. Game changer. Even now.

I need this in my life 👍🏼👍🏼👍🏼👍🏼👍🏼👍🏼. One person micro studio to create micro scifi short form story

a good worklow would be to record composite and separate virtual camera+greenscreen, edit with the composite and re-compose after all editing is done. so, shooting and editing with excellent preview, while mainaining full compositing for output. this workflow would require rec/stop/save commands to be sent to unreal through sdi, and auto-naming of both unreal sequences and camera, to help with camera assistance.

Well done. And here we go!!! Off to HomeDepot to make that green screen frame. Big thanks to wify. :)

this is awesome

Brilliant !

Really Cool

Amazing thanks so much!

awesome as always, if you can do a vlog on tracking would be very good, I am so inspired like you, I am a screenwriter now learning to make movies virtually

This looks great! It makes green screens much more believable! S'il y a des français passant ici: la team JDG a très probablement utilisé ce tutoriel pour leur nouveau système de fonds verts ^^. C'est le même équipement, les mêmes logiciels, et le même niveau de rendu.

This is some next level stuff Matt! Would love to set up a rig like this at home for a static camera!

Brutal !!!!! Thanks you

I’m a bit late but thanks Matt. You’ve earned a sub

Hi Matt, Looks great ! Can't wait to see how it connects with cine tracer. I have a request though. Could you please do a traditional newsroom setting that looks pro ?

Man...this is genius

Nice!

very cool

I was thinking of trying the new intel realsense tracking camera as a way of doing the tracking on the camera, rather than using the vive method. I've seen bigger production sets using inside-out camera tracking where they markup the room with tracking markers and then just have a camera pointed at the ceiling with a bit of software to position and orient the camera (which is basically what the intel tracking camera is doing, but doesn't use markers). Ideally I guess you'd have a rear projection screen behind the cam for environment lighting. Ah man, if only I had the funds I could play all day with this kind of thing.

Hey, really enjoyed your video and in-depth and clear breakdown for a VP setup. I was wondering however, if you could share how to setup just Vive tracker + base stations without the HMD i don’t have an HMD and having an extremely hard time setting those up with unreal. I keep hearing they are super easy to configure but can’t find any easy setup videos for that. I was hoping if you could help explain that. Also tried following you along the configurations you showed in unreal here and can’t find most options you mentioned here 🙏🏽

so how does it work with post... Are you recording on the Ursa also, and then give the unreal engine and tracking data and raw footage to the editor for posting the feature film?

How do you get the pull focus from the lens to get unreal to sync with it, or is the lens focus part just for the mixed reality and not just filming all unreal content. This new wave of technology that your doing and what the Mandolorian crew did just makes me so excited to see live tracking from the RL used for camera recording. Its like VR had to be a thing with the whole tracking aspect to then have people get the idea of using tracking for virtual cameras, then it moved onto the next stage with Mixed Reality. Truly a breakthrough in the filming production world and a way for the gap to shorten between a small indie studio and the big corporate film industry. Similar to when home recording software became so user friendly and pc hardware became cheap enough for bands to record there own music in a small studio without having to pay alot of money for studio time from a big one. I hope that made sense. Anyways this is amazing and definitely the future. Im a CG artist and this kind of stuff really gets me excited and very interested in wanting to know more.

pretty cool ! Amazing ! I am learning a little bit of Unreal, Can you use any digital camera, like for example a Gh4 ?

Question for you: Where did you get the greenscreen background? I've been searching on Amazon but couldn't find a decent one. I'm going to try a virtual setup like this (I'm an AI programmer, so want to do some realtime virtual characters with live actors interacting.

An idea for lighting. Get a large TV screen, place it close to the model and send another feed of the virtual environment (taken from th eopposite direction of the camera). Tune the lighting can camera for low light so that the effect of the TV is more pronounced. Now the reflection of the light from the TV on your model makes them look more immursed. It should help to counteract all that green light pollution. It's all about proximity.

Hey man, this is amazing, thankyou very much. Just one question, once you have everything set up how do you record it? I mean, to have the render video of what you were filmed in real time. Thanks in advance!!

Hello Matt, thank you for the details on the video. I have a question. Right now I am shooting green screen on a much higher shutter speed than my frame rate requires for perfect motion blur, to be able to have a better keying in post. While live compositing is the way to go, what happens if I really want to add back the motion blur I sacrifice for the green screen? Match the shutter speeds of the real and virtual camera to match the green screen, record my scene and then add motion blur in post, or can it be done on the output comp from the engine? Thank you!

HI Matt. You do an amazing job. I am trying to do the same with a Vive and a GH5. Could you please recommend some resources? Thanks.

@Cinematography Database where did you get that spaceship model from? I'd like to give it a try. The Epic virtual studio models are all very bright, I'd like to try something that looks good in dim light.

This is fantastic. I would love to learn how to do this. So, to be clear this is UE4 Composure that you are using?

Hi Matt, love all your videos. Quick (newbie question) - how can I record the CG clean plate (or just get the tracking info) if I just want to use the live comp as an on set preview and do post later? I feel like there's a really simple answer for this, but I'm not sure what it is.

Really cool-I just ordered a Roko because all of this virtual production is too next level. Have you had any luck trying to get some sort of lightwrap going on for realtime keying?

Did you have to track these? I saw you didnt have any tracking markerw on the greensreen but had camera movements.

🔥🔥🔥🔥🔥🔥🔥👏🏼👏🏼👏🏼👏🏼👏🏼👏🏼

Great videos love it!! Question for you though. I don't have an htc vive setup (yet.. covid $$ issues lol) so I'm trying to achieve similar results by using the iPhone as a tracker. Even though I match my cinecameraactor settings to my DSLR, i find they don't quite match in unreal. You don't seem to be having this issue with the vive trackers. what "information" do they give back.. Transform? world location? distance between cam and tracker? thx! Marc.

interesting stuff. is there a lightwrap effect in the unreal compositor? that would help a lot.

If you export tracking points from AE's lockdown plugin into Maya or blender you might be able to improve the lighting situation. Have each point drive a vertex on a 2d cutout in 3d space and use a 360 photo-sphere to light the mesh then re composite.

SUGGESTION: If you just get the LUT you want loaded onto the Blackmagic you can send that over the SDI, you would not have to add a grade in Unreal (saving you some processing power on that computer)

Is UE calculating the lighting in real time, or is the set "baked" lighting? Either way, looks like a fantastic start for a setup based on mostly "consumer" gear! You are really opening the door for a lot of productions!

Matt do you know if the BM Video assist can record BRAW from the Ursa mini 4.6k? not the pro but the first 4.6k hope you tech guy can answer that will be really really helpfull. thanks for your knowledge.

is there a way to get this camera tracking but with just an unreal camera? composure + putting the composite plane in one place, wondering if this is possible? Love the work as always!

Dear Matt; I have an exact setup like your early days. I need an answer if you please 🙏🏻. I am connected to unreal via decklink card and I get keyed preview in viewport. I use composure and also I use Media bundle projected on a plane. all are perfectly working. WHAT I CANT achieve is to record my editor viewport in the UE. Is it mandatory to use an ext recorder via decklink in order to record.? I DO NOT WANT OBS or alike as a screen capture is there a way to record in the Unreal engine like take recorder or seq rec.? APRECIATE your time and help.

How is the video signal coming to UE4, does UE work on the "raw" captured signal or does UE do fast compression? How good is the UE keyer, looks a bit limited. Woukd not be better to work with an external hardware keyer that does a key on a 444 signal then pass that to ue, or would that add to much latency ? Sorry for so many questions but i just started with this and i am interested to have as little as possible quality loss from lens to output.

Hey Matt, with green screen (not a video wall obviously) if you recorded the raw camera feed and tracking data you could easily tweak the UE scene after the fact and re-render. That way, if the lighting wasn't perfect, you missed something glaring in the background during the shoot, the key wasn't perfect or whatnot, you have way more flexibility in post. Doesn't stop you from also recording from the monitor.

hola que tal, excelente el trabajo que haces y los totorales y todos tus videos, felicitaciones! queria consultarle lo siguiente: que tipo de hardware de pc (placa de video, procesador, ramón, etc) es necesario para realizar este tipo de trabajos? desde ya muchas gracias y espero tu respuesta

Hi Matt! How do you output your Vlog video from Composure? Is there a straight forward way to output the composited image from Composure to a .mp4 file? Thanks!

Great Setup, i‘m gona try to build this in future, are you planning to connect your setup to cinedesigner ?

Matt can you make a tutorial to a live stream with a chroma key, but with a camera movement like a last shots, when you moving the camera and the background moves too pleeeeaaaasssseeeee

This video was the push i needed that made me want to learn virtual production! I can now send live video feed to a level but im struggling with two things. Is there a way to bind a hotkey that displays and hides an image or element relevant to what the actor is talking about in a live situation? Also, how can i record the final outcome of a live feed on PC? I dont have a ursa and SDI out :( Thanks!!!!

Is the vive tracking ready for broadcast production? Are vive making tiny random movement while tracking?

looks good, though a way to match the lighting in the scene better would be a big improvement.

So this is awesome! But how do you think we can merge and sync the focus pulling between virtual and real cameras?

I am trying to put foreground plate over media plate and added simple cube to foreground layer, it shows black background along with cube. ...already changed "alpha channel to linear space color only". Suggest if i am missing anything.

If I wanna do this live on Twitch or something, is there a way to do it without the live feed ending every time I try to play the level? I want to utilize some spider AI I coded, and their animations, but can't because this method only seems to work in the editor.

Hi Matt. If I want to buy a video camera compatible with Unreal Engine to connect and shoot with chroma input directly after 3D creation What do you recommend to buy the type of camera compatible with the fifth version

Hi Matt! Hope you can help me. I have spend countless hours trying to get composure to work but something isn't right. The CG layer looks completely different compared to the actual scene. It is as if it doesn't read any of the post processing or lighting properly. Any advice on what I can do to fix this. Thanks

Hi Great Video, Thx Which Computer configuration is necessary to run such setup ?

Hi, we are doing some testing with unreal using composure based on your tutorial. But our final preview is darker than the view port when we capture from composure. Need your advice on how to solve this issue?

Nice! Which graphics card was used?

Hey Matt, I’ve been following along with your experiments and it’s very exciting to see your results. I have a question, as a Unity dev I’m not that familiar with Unreal but is there a way to add a trash matte to a wide shot in this setup? The talent would still be within the key but around that, possibly and rgb green layer to mask the rest of the studio? Thanks and keep up the great work!

This is great but how can you record the video composed in unreal to record it for example?

Hello, I'm working with Composure and the cg_layer color is way off, its bad and not as good quality as the CineActorCamera. Have you come across this issue where Composure's view is different from your CineCameraActor?

Hay bro ,I like yr tubes .what about ptz aw ue150 plugin ue4 with vive tracker

how can we start a small virtual production . any simple DSLR tutorial Plz

Wow! Im really excited to try, but an HTC vive is ridiculously expensive in Brazil xD Does anyone know if its is possible to have high quality with any other VR set ?

I know it takes a little longer but would it increase quality to record the foreground and back ground sperate and then key in the background in post? I was even thinking that you could record the background on a 4k Blackmagic video assist so that it's all Blackmagic RAW.

Question! Is it possible to monitor the composite real time, record the camera internal and UE separately, then do the composite later in an NLE? For example...Record everything, export the recorded UE sequence, bring it into Resolve, insert the green screen camera file and key in Resolve, match the timecode to overlay camera on the UE sequence? This will keep my Alexa file in the highest quality (Proress 4444), and will have greater control over the captured image for grading.

Is there a way to sync camera aperture value and shutter angle w/ background blur and motion? I imagine this is another limitation of the green screen vs an LED wall. Is there a way to get accurate dof based off of lens focal length, aperture values, and focus points? I can't imagine that kind of data is output by cameras and available to Unreal engine to calculate.

Is it possible to have a static physical camera (so no tracking info) into unreal engine and move a virtual camera around in unreal engine?

It's possible to connect the vive Tracker in the steam without a headset?

Please could you tell me or point to a link where i can create a material "Andy's Tutorial"?

u can share the BP? i have htc camera tracker, but i cant get the same result as you in 9:15

Hi, if I use Take recorder for record project , how to setting ? Thank you so much

Thank YOU!! Can you make the background out of focus and play with forcus in general? Best Marco

How are you setting up the tracker distance to the lens? Are you just estimating the distance? Because there's parallax between the camera position and the tracker position and it's not looking good atm for me