Old Space. Virtual Production with Blender?!

Рет қаралды 10,788

3 жыл бұрын

In preparation for a recent shoot of a pilot for a webseries we made this little test, which we also wanted to use as a little demo to showcase our current virtual production setup, which is still a work in progress.
The main point of it is to avoid post production, and to have live output that the production company can use directly.
We use Blender and the Eevee viewport to deliver the visuals, powered by the XR-branch: developer.blender.org/D9124
There are some issues still like a bit of stuttering, which we are investigating. We suspect it's some issues with different monitors not running exactly at 60/30fps so there is some frame dropping from time to time.
Hardware used:
Camera: Sony α7S II
Wireless HDMI Transmitter: HollyLand Mars 300pro
A field Monitor
Blackmagic Atem Mini
Lots of cables...

Пікірлер: 40

@mahirfr 3 жыл бұрын

Glad to see blender being this much interactive and realtime,.. woah. mind blowing.

@iCamSkiEz 3 жыл бұрын

That intro was fucking golden dude hahahaha I'm on a plane

@HuanLeVuong 3 жыл бұрын

Hey, you were the instructor who taught compositing on Blender Cloud! I liked your courses, very helpful! Glad I found your channel on KZfaq!

@ubong120 3 жыл бұрын

can you do an i depth tutorial for this set up

@BlenderFan 3 жыл бұрын

Amazing and happy blending with blender.

@best_f1ghters 2 жыл бұрын

Wow, it's wonderful

@stefanguiton 3 жыл бұрын

Excellent!

@unskillednaive416 3 жыл бұрын

Amazing 🔥🔥🔥🔥🔥🔥

@Q1w1N 3 жыл бұрын

Wow, that's super cool!

@mattpallotta 3 жыл бұрын

Love it!

@jaycehfilms8741 3 жыл бұрын

fun fact you can do something similar by taping an iphone with virtucama running to your rig, you just have to keep the movements reasonably smooth

@pipeliner8969 3 жыл бұрын

so cool!

@virtual_intel 2 жыл бұрын

Interesting tech you guys are playing with

@mulagraphics Жыл бұрын

Looking for videos on youtube about Blender virtual production is like pulling teeth no one gives you a clear A-Z explanation. Like how to setup your camera rig? how to setup virtual production scene in blender? what blender addons should i use for virtual production? etc

@hman2912 3 жыл бұрын

So Avatar of you. Love it. How do you have so few subscribers?

@gjohgj Жыл бұрын

Old Spicy😄

@ZeroNineFilms 2 жыл бұрын

I need to learn this

@Clovenlife 3 жыл бұрын

would love to see a detailed video on how you trick blender with the tracker and how you configured that build. That branch is already marked abandoned which is really disappointing

@Blendfx 3 жыл бұрын

Don't worry, XR action development is still ongoing: developer.blender.org/tag/virtual_reality/

@istitutocomprensivogalileo4974 2 жыл бұрын

Amazing! I'd love to try it with my students. In the past, we used Blender for simple FXs (I'm writing from my old school's KZfaq account: if you are curious, you'll find some experiments on the channel... just don't expect too much!). Real-Time effects would be a proper game-changer! I made some tests with Blender 3.0 + Oculus Quest. I tried to use the Quest as a cheap tracking device, but I can't find a way neither to change the focal length of the camera mirrored in viewport nor to parent a "normal" Blender camera to the mirrored one. This step is necessary because I think we need to match the virtual camera's focal length with the real camera's focal length, don't we? You used a Vive Tracker, so I was wondering how you achieved to parent the Blender camera to the tracker. I hope I made my problem clear (I'm from Italy and my English is poor: I'm sorry!). Thank you... and happy new year!

@istitutocomprensivogalileo4974 2 жыл бұрын

I found a possible solution: the Motion Capture option! It's not present in the official Blender 3.0, but it works well in the 3.0 alpha with VR/XR Controller Support (GraphicAll). I hope it will be merged in the next stable version as it opens so many possibilities...

@stevecypert 3 жыл бұрын

I have a friend to had some jitter issues with the Vive Tracker. He followed some tutorials by Richard Frantzen and switched to Aximmetry as it solved the jitter problem.

@duchmais7120 2 жыл бұрын

Thanks for sharing video. the thing about monitors and frame rates got Me thinking...any other setup would not work? 30fps and 60 Hz??

@ShawnTBell 2 жыл бұрын

Cool stuff. I found the Vive on Amazon, but could not make out what you called light hoses or lighthouses on the stands, what are they?

@Blendfx 2 жыл бұрын

google „vive lighthouse“. they are needed for tracking.

@roylee3108 3 жыл бұрын

Ah... very nice introduction of the workflow and setup. Just one thing, you looks a little bit shy..

@veleares Жыл бұрын

How does Blender get the camera data? xyz coordinates, where to move the object and the background.

@latentspacex Жыл бұрын

Is this still under development? Also - there is no other way to get image from blender other than to desktop capture the viewport window?

@gstorm1491 3 жыл бұрын

Congratulations wow! What do you use as a computer and video card ?

@Blendfx 3 жыл бұрын

A rather old 6core machine with 16GB Ram, but an RTX2080super.

@qvnzfdasfg 3 жыл бұрын

What you Use Vive tracker To track blender Addons?

@mxaxolotl 3 жыл бұрын

The problem of tracker and camera offset is very difficult to solve (so sad)

@shekiba.646 3 жыл бұрын

can you teach me to how set on blender with base station or vive tracker something and let me know. thanks. I like your tutorial.

@retromograph3893 Жыл бұрын

Why you guys not using Unreal Engine, isn't that much more suited to this?!

@user-cv3ex1nq8x 2 жыл бұрын

how to get an image from the camera in real time?

@mouxionstudio7929 19 күн бұрын

Tutorial please 🙏

@tuarkmuart2988 2 жыл бұрын

mega fett :)

@CHROMAAUDIOVISUAL 2 жыл бұрын

who names the device put on a camera?

@eisblockstudio 2 жыл бұрын

The device on the camera (used for the positional tracking) is called, as Sebastian says in the video, -> Vive Tracker (from HTC).