Setting Up a Virtual Camera | Vive Pro + UE4

  Рет қаралды 84,721

Cinematography Database

Cinematography Database

4 жыл бұрын

In this video we unbox and setup an HTC Vive Pro Virtual Reality system. We then use the Vive Controller in Unreal Engine 4 to create a basic virtual camera. Finally I implement a prototype virtual camera system in Cine Tracer using the Rokoko animation from the previous vlog.
HTC Vive - www.vive.com/
Redrock Micro - shop.redrockmicro.com/
Unreal Engine - www.unrealengine.com/
Cine Tracer - store.steampowered.com/app/90...
*this is not in the current build of Cine Tracer yet

Пікірлер: 153
@ContentMonsters
@ContentMonsters 4 жыл бұрын
YES!! YOU DID IT!! So NASTY with the HEADSET ON! Excited for THE FUTURE!!
@tomdchi12
@tomdchi12 4 жыл бұрын
I'm right there with you at the end "this is crazy... this is crazy..." That natural camera movement, real time lighting and the dof... The result really is astounding! My only question was wether having characters run off the suit in real time was possible, and you're saying "it should be easy." That's all just mind blowing! Congrats!
@geoffreybassett6741
@geoffreybassett6741 4 жыл бұрын
Absolutely blowing my mind with this tech. Hopefully investing in a VR setup soon and can explore this setup.
@karl_raymond
@karl_raymond 4 жыл бұрын
Amazing man! Keep up the good work. This blows my mind. I could use this on so many projects.
@pushREC
@pushREC 4 жыл бұрын
Wow this is so damn cool - great to see the leaps of progress you're making!
@HCKNEOBOOM
@HCKNEOBOOM 2 жыл бұрын
Very excited for the future of VFX and Cinematography Matt.
@emirbublis154
@emirbublis154 4 жыл бұрын
You changed the whole cine world! You are amazing, man!
@MrPierce200
@MrPierce200 4 жыл бұрын
Congrats man! Really appreciate what you are doing
@JYTVSOC
@JYTVSOC 4 жыл бұрын
i'm glad you caught up with us down here. ;) Busting your chops. Great job. Thank you. Now actors and a set in green screen and cinetracer.
@alphaohenriquez
@alphaohenriquez 4 жыл бұрын
Awesome work!!! This going to take entertainment to the next level
@sethreber9906
@sethreber9906 4 жыл бұрын
Dude this is so sick... Looks amazing.
@zucchini3D
@zucchini3D 4 жыл бұрын
Thanks so much for your insight! This is an incredible way to control camera movement, wow
@AshConnaughtonDP
@AshConnaughtonDP 4 жыл бұрын
this is nuts man! like your are gonna bring VP to the masses!
@OneSideMediavideo
@OneSideMediavideo 4 жыл бұрын
Wow! It’s kick ass! Love it
@Elizabeth_Postol
@Elizabeth_Postol 4 жыл бұрын
Amazing and very informative. Thank you!
@RujenMaharjan
@RujenMaharjan 4 жыл бұрын
That is incredible!
@GoldCreekVR
@GoldCreekVR 4 жыл бұрын
FILTH FEST '06!! CONGRATULATIONS MATT...YOU DID IT! YOU SET THE CHILDREN FREE!
@sobeso
@sobeso 4 жыл бұрын
Although I don't watch all the videos I'm always interested in all of them, this was cool.
@Johnny_frost
@Johnny_frost 4 жыл бұрын
This is incredible!!!
@harryassouline
@harryassouline 4 жыл бұрын
Your videos are very instructive.
@maxxender
@maxxender 4 жыл бұрын
Incredible.
@II-er7gj
@II-er7gj 2 жыл бұрын
This is so DOPE!!!
@muyunwang2821
@muyunwang2821 4 жыл бұрын
Amazing!
@jonathanherrera9034
@jonathanherrera9034 4 жыл бұрын
This answered my question on another video! focus is controlled on the controller.
@CGokce6
@CGokce6 2 жыл бұрын
Hi how'd you get it to focus / zoom on the controller?
@JLOFlix
@JLOFlix 4 жыл бұрын
Matt this is FANTASTIC!! THANK YOU for this video series! I had a question...could you tell us the specs of your computer and how many we might need? I've heard that the big time setups require upwards of 7 (or more) for different VP responsibilities, but, I'm eager to learn all of this goodness! Thanks again!
@josenegrete
@josenegrete 4 жыл бұрын
Marvellous :)
@slippycam
@slippycam 4 жыл бұрын
That is so awesome
@StyllionMovement
@StyllionMovement 4 жыл бұрын
Speechless
@Allenvisuals
@Allenvisuals 4 жыл бұрын
Damn. Nice one Matt... so I guess you could wear a VR headset while operating the camera so that you could also be immersed in a VR scene with the mocap characters?
@manikkrealm
@manikkrealm 4 жыл бұрын
Epic. This is Epic.
@thomasshawcroft
@thomasshawcroft 4 жыл бұрын
This is a game changer !
@ifilmschool
@ifilmschool 4 жыл бұрын
Congrats really looking forward for more content!
@JQhardge
@JQhardge 4 жыл бұрын
Woooooooooow! 👏🏽👏🏽👏🏽
@devinteer3205
@devinteer3205 4 жыл бұрын
Great Video! Thanks for sharing so much information. On your virtual set up what type of monitor do you recommend?
@chrisduwe
@chrisduwe 3 жыл бұрын
Hey Matt, thank you for all the videos you are making!!! I am just getting started with my Rokoko suit and am setting up a virtual camera rig like the one you have on one of your videos. How do you connect the little monitor on the shoulderrig to show what unreal is showing? What kind of little battery monitor are you using on the shoulderrig? Thank you!
@SpiritscometogetherProductions
@SpiritscometogetherProductions 4 жыл бұрын
Wow you just blew my mind love it 😍🎬📽 I see you have an Atomos Monitor on your rig imagine using an HDMI transmitter to send you pc signal to the Atomos Monitor 🎬📽😍 that would be so Awesome : ) keep up the great work 😉
@poloo92
@poloo92 4 жыл бұрын
Actually the headset has a wireless module , i don't know if it works like that , but it would be a really nice upgrade.
@SpiritscometogetherProductions
@SpiritscometogetherProductions 4 жыл бұрын
@@poloo92 Awesome 😎
@taunado
@taunado 3 жыл бұрын
That works right? No lag?
@indrakomara6966
@indrakomara6966 4 жыл бұрын
I think you just bring the latest hollywood VFX to our home
@davidedwardsme
@davidedwardsme 4 жыл бұрын
Curious, noticed you were always looking at the monitor, could you rig this up so you're streaming to the monitor on the hand held rig?
@phantom000x
@phantom000x 4 жыл бұрын
Thank You !
@chewcrypto6012
@chewcrypto6012 4 жыл бұрын
MattWorkman coming at us from the year 3000.
@vressentials
@vressentials 4 жыл бұрын
Hi Buddy amazing video, would it work with a third controller for the Oculus Quest to do the tracking and use of same software, as the Quest is wireless?
@minakovstudio
@minakovstudio 4 жыл бұрын
This fking amazing! Take my money!
@GabrielFrancisMUSIC
@GabrielFrancisMUSIC 4 жыл бұрын
Great video! Thanks for posting. I'm thinking about assemble a similar setup here for real time Chroma Key compositing in my studio in Brazil. I would like to know if with the HTC vive, the old one, I'm able to work with stability. Thanks so much
@fotusknight
@fotusknight 4 жыл бұрын
Neos vr has a camera within the game engine that you can parent to anything including trackers as with any object.
@beatcityinc
@beatcityinc 4 жыл бұрын
Yeah!!! Now let’s get that ronin S out!!!
@joelarvidsson
@joelarvidsson 4 жыл бұрын
It makes so much sens to use cinegracer like that (and the direction I wished for). But In best of worlds we could hit button on the virtual camera to start stop the recordings. I would love to se some livekeying with people intigrate with a 3d set.
@CinematographyDatabase
@CinematographyDatabase 4 жыл бұрын
Joel Arvidsoon I have it setup where you can record footage onto the Atomos, so the cam operator controls the recording. I’ll do some simulcam with green screen soon.
@SpektorBaal
@SpektorBaal 2 жыл бұрын
May i ask what clamp are you using? I am trying to setup on my mirrorless camera and the controller for my vive 1 thank you. Great video
@kiukle
@kiukle 3 жыл бұрын
Came here looking for An explanation step by step of how to actually hook everything up. Some good info But also lacking in how to actually make any of this happen. Would love a step by step tutorial about how to link the Vive to Unreal and get it to recognize it then set it all up to function.
@joachimkarstens9769
@joachimkarstens9769 3 жыл бұрын
Thank you for showing how to wire it up in unreal! What do you think how much time is needed to figure out how to input a live camerafeed into Unreal, do a key there and also record the cameramovement and match it to the video? (well, you could just use a flate to sync the raw video and a videofeed recorded within Unreal I guess, but maybe there´s a smarter way)
@theindependentcinema
@theindependentcinema 4 жыл бұрын
💚
@Ezell2film
@Ezell2film 3 жыл бұрын
Can you just purchase the HTC base stations and the controller? Or do you need to purchase the headset as well to make this work?
@sinanarts
@sinanarts 3 жыл бұрын
Thx for the tut. Can you please say is it enough to have 1 base station and a controller without the headset..?
@theozstudio1
@theozstudio1 2 жыл бұрын
Quick question: Is there a way to record the tracking information and use it later? Say a character is shot against green screen and all we want to do is record the tracking info and use it later while compositing
@wackcrewpeeps
@wackcrewpeeps 3 жыл бұрын
Hey Matt, thanks for making this video. Have watched almost all of your VP videos and am setting up my own little studio at home. I'm working on the virtual camera now and was wondering if you could post the parts you used for your handheld rig online?
@wackcrewpeeps
@wackcrewpeeps 3 жыл бұрын
Nevermind I found it on one of your other vids
@12KINTERIORS
@12KINTERIORS 4 жыл бұрын
can you explain can i use the same virtual production with oculus quest? can the joystick works same as vive tracker?
@Calwyne
@Calwyne 3 жыл бұрын
Any idea if you can use vive trackers for mocap and as a virtual camera tracker simultaneously?
@georges8408
@georges8408 4 жыл бұрын
Hey Matt, can you please make a tutorial how to set up all this staff ? I mean the connections, the set up in unreal / cinetracer etc.
@FeedingWolves
@FeedingWolves 4 жыл бұрын
George, I have the same request! If there is a tutorial on how to set all this up that would be awesome!
@whnvr
@whnvr 3 жыл бұрын
yeah i'm a little annoyed that he skipped out on so much
@thomaspipermusic
@thomaspipermusic 4 жыл бұрын
Question is there any way to do this on a Mac . Maybe use a iPad as a tracker any thoughts?
@sergeyafanasiev3896
@sergeyafanasiev3896 3 жыл бұрын
Do you record video on video recorder for the future post production or video can be recorded in UE4 ?
@whnvr
@whnvr 3 жыл бұрын
hi there! would you be at all willing to do a more involved tutorial setting up this system from scratch? especially for other controller variants like the index controllers. thanks.
@3DShe
@3DShe 2 жыл бұрын
Can we use just the controlar with those 2 sensors without buying the vive headset?
@pentecostesish
@pentecostesish 4 жыл бұрын
Hi, thanks for this tutorials, but have one question. This camera is correct for work with UE4?. -Digital Video Camera: Brand: Andoer Color: Black Chipset: Adopt for Novatek 96660 Sensor: Adopt for Panasonic 34110 14MP CMOS Sensor Lens: f=7.36mm F3.2 Screen: 3inch Capacitive Touchscreen Video Resolution: 4K (2880 * 2160) 24fps (interpolation) (2560 * 1440) 30fps (1920 * 1080) 60/30fps (1280 * 720) 60/30fps Photo Resolution: 48MP(9212 * 5184) (interpolation) 36MP(7936 * 4480) (interpolation) 24MP(6340 * 3600) (interpolation) 16MP(4640 * 3480) Format: JPEG (photo); MP4 (video) Continuous Photo: 5photos Self-timer: Single 2s 5s 10s Loop Recording: OFF 3min 5min 10min Function: WiFi Anti-shaking 16X Zoom Face Detection Motion Detection Date Stamp White Balance: Auto Daylight Cloudy Tungsten Fluorescent Color: Colorful White Black Sepia ISO: Auto 100 200 400 USB Port: 2.0 Exposure: 2.0 Auto Power OFF: OFF 3min 5min 10min TV Mode: NTSC PAL DC: 5V/1A Language: English/French/Spanish/Portuguese/German/Italian/Chinese/Russian/Japanese Battery Pack: 3.7V 2500mAh 9.5Wh Lithium Polymer Battery 45.5g One Cell (Included.) Memory Card: Support up to 64GB External Card (Not included.) Operating System: Support for Windows XP/Vista/7/8 for Mac 10.2 or Above Item Size: 11.8 * 5.5 * 6.5cm / 4.6 * 2.2 * 2.6 Item Weight: 326g / 11.5oz (With battery.) Thanks for you help.
@Drahoslav_Lysak
@Drahoslav_Lysak 4 жыл бұрын
👍
@MarcoDeNuzzo
@MarcoDeNuzzo 4 жыл бұрын
if I use get tracked device with the vive first version it doesn't work, I have changed the channels but nothing.In other ways like using the paws it works well.I only use motion controllers, I don't have a tracker
@Marc-hy8cf
@Marc-hy8cf 3 жыл бұрын
Also is there a way to record the camera data to use lets say in C4D or After FX?
@MisterGiant
@MisterGiant 2 жыл бұрын
Do you need the Vive Pro? Or can you buy just 2 basestations and a vice tracker? That would save a lot of money.
@Marc-hy8cf
@Marc-hy8cf 3 жыл бұрын
Is the blueprint setup you have an alternative to the virtual camera plugin in unreal?
@jounalansman1769
@jounalansman1769 3 жыл бұрын
So do you actually need the headset for this or is 2 base stations and a tracker enough?
@korekproduction60
@korekproduction60 3 жыл бұрын
Hi Matt, just a simple question.. do you think there is a solution to connect the old HTC Vive,.. As I noticed everyone is using the pro, do you think there is a way to use the old one?
@ronshalev7910
@ronshalev7910 4 жыл бұрын
Hi Is this possible to do also with Oculus Quest controller?
@fvgoya
@fvgoya 4 жыл бұрын
This is really cool!!! Just one question: Why even with the camera rig the VR looks little shake? Does not should looks more stable, because of the camera rig? Thanks!
@MrSinelnikov
@MrSinelnikov 4 жыл бұрын
I think it literally translates controller movement into virtual units without any smoothing. To add that sort of smooth movement you just need to skip virtual camera movement when its less than some threshold, or instead add some delay(0.1 sec) to smooth movement and skip those intermediate movements and move virtual camera to final position. In general there are a lot of different approaches how to smooth movement
@fvgoya
@fvgoya 4 жыл бұрын
@@MrSinelnikov I see. Thanks for explain it man!
@josenegrete
@josenegrete 4 жыл бұрын
Exactly. Filtering and modulating will do the work.
@voidn833
@voidn833 2 жыл бұрын
@Cinematography Database You think it's possible to set this up with a Oculus?
@abhilashkrish
@abhilashkrish 3 жыл бұрын
Can you please let me know the products from Redrock you have used for Cage?
@sinanarts
@sinanarts 2 жыл бұрын
As soon as I unplug my CONTROLLER from usb port of my computer I loose the connection. I DO NOT have dongle. I have 1 base station and a controller as rig. Any support how to fix this.?
@Wade978
@Wade978 2 жыл бұрын
Aside from the vive, what does the rig consist of in parts and items?
@hunterboen6410
@hunterboen6410 4 жыл бұрын
Just curious, but how does the Vive headset fit into this equation? In theory if you get the trackers and the base stations separately is the headset even necessary?
@nightterry2274
@nightterry2274 2 жыл бұрын
Hey Hunter, did you ever figure this out? I've been wondering the same.
@fatrabbitvideo3112
@fatrabbitvideo3112 2 жыл бұрын
I to am trying to find the answer to this qustion.
@JustinFernandez6
@JustinFernandez6 4 жыл бұрын
do you know if it would work with Rift controllers and sensors?
@sergeyafanasiev3896
@sergeyafanasiev3896 3 жыл бұрын
Hi. Shoul I have full vive head set , or for setup enough only tracker?
@MrPierce200
@MrPierce200 4 жыл бұрын
Question from a total newb: Primarily for live compositing. Is the entire vive set necessary or could I get results with just the controller and base stations? Thanks for sharing!
@CinematographyDatabase
@CinematographyDatabase 4 жыл бұрын
You can use the controller. As long as the base Stations can see it it will be fine.
@piotreksternicki
@piotreksternicki 3 жыл бұрын
@@CinematographyDatabase Does one base station and htc vive tracker can do the work or maybe two basestations are must?
@abhilashkrish
@abhilashkrish 3 жыл бұрын
What was the product you have used to mount HTC VIve Tracker?
@themessengerofgood
@themessengerofgood 4 жыл бұрын
Hi! How are you set input from controller for changing focal lenght? I ran into a problem - I can't find any motion controller inputs in BP in 4.24.2
@CinematographyDatabase
@CinematographyDatabase 4 жыл бұрын
Oleg Mazunin I’m using 4.22. I heard they use the OpenXR for 4.24 but haven’t tried it
@agha809
@agha809 4 жыл бұрын
hi, can you show blueprint tutorial for camera please (4:03)
@williamhill3288
@williamhill3288 3 жыл бұрын
Oh wow can you live stream from that camera itself? If you can you can assign that camera a position in game. To stream the graphics in. You still need a player camera on the i stall
@sinanarts
@sinanarts 4 жыл бұрын
Hey there, Is there a way of doing this with Rift S device ? A clear answer is much appreciated :)
@amitsheokand011
@amitsheokand011 4 жыл бұрын
NO. This needs Room(lighthouse) tracking. Tracking in Rift S is done through front cameras(very limited). Room tracking will be nearly impossible to do with Rift S.
@sinanarts
@sinanarts 4 жыл бұрын
@@amitsheokand011 Thank You very much.
@NiteshKumar-cs4wo
@NiteshKumar-cs4wo 4 жыл бұрын
Where you to buy. Is this all thing available in Amazon
@jibi_jibs
@jibi_jibs 3 жыл бұрын
Quick question: what if I use oculus controller instead vive controller? Will it still work?
@robertm3005
@robertm3005 2 жыл бұрын
Hello, I wanted to know do you need two base stations to be able to work one tracker or do you need two?
@CinematographyDatabase
@CinematographyDatabase 2 жыл бұрын
I’ve heard of one base station working, but 2x is a much safer bet
@RobHuntProductions
@RobHuntProductions 4 жыл бұрын
So if you just want to do the camera tracking can you get away just buying the controller???
@DwiAgungPambudi
@DwiAgungPambudi 4 жыл бұрын
How the is tracker compare to the regular Vive?
@waltonng1245
@waltonng1245 4 жыл бұрын
does this work with Vive as well or it only works on Vive pro?
@Pedrangelo
@Pedrangelo 3 жыл бұрын
Wow! Im really excited to try, but an HTC vive is ridiculously expensive in Brazil xD Does anyone know if its is possible to have high quality with any other VR set ?
@FF-FAN9999
@FF-FAN9999 3 жыл бұрын
just to make sure., the virtual camera, you can record the motion into a track inside ue4 right? im thinking about using this to record camera movement into the cinematics, but not just recording video that the camera is seeing
@DnallohLeoj
@DnallohLeoj 3 жыл бұрын
You can use either Sequencer Recorder or Take Recorder for that. It's super easy to use Sequence Recorder for this. You just add your camera actor to the recorder, start your simulation, and hit record. It'll give you a countdown and then record the camera data. The one thing is if you try to render out your recorded sequence in-engine, you'll need to disconnect the tracking code from the Event Tick, otherwise when the engine reruns the sequence simulation to export your video, it'll be overridden by your virtual camera.
@FF-FAN9999
@FF-FAN9999 3 жыл бұрын
@@DnallohLeoj thanks!
@yimmonirak2651
@yimmonirak2651 2 жыл бұрын
i need position and rotation data can i use vive tracker without base station device?
@P4TTT
@P4TTT 4 жыл бұрын
Can I use the non-pro version of HTC Vive for UE? Or HTC Vive Pro has any significant improvement in terms of tracking?
@CinematographyDatabase
@CinematographyDatabase 4 жыл бұрын
The original Vive should work fine. The newer Base Station 2.0 are able to make bigger tracking volumes and are preferred. But getting started the 1.0 version will work.
@joelarvidsson
@joelarvidsson 4 жыл бұрын
A question about the mocap suite. There are a few mocap suites, and I wonder why you picked up this one?
@CinematographyDatabase
@CinematographyDatabase 4 жыл бұрын
Joel Arvidsoon you mean the Rokoko? It’s a good price point at $2500 and integrates into UE4 pretty easily.
@taunado
@taunado 3 жыл бұрын
@@CinematographyDatabase Today, do you reccomend rather using DeepMotion for hobbyists? Seems like Rokoko requires a lot of tweaking, and AI tech is getting insanely accurate with frequent updates to remove glitches
@emefka.bewegtbildmanufaktur
@emefka.bewegtbildmanufaktur 4 жыл бұрын
How about insight Out Tracker like the Oculus Quest? Will that work in future updates?!
@CinematographyDatabase
@CinematographyDatabase 4 жыл бұрын
emefka.bewegtbildmanufaktur I have only tested the Vive Pro.
@DanielRodriguez-gm1ih
@DanielRodriguez-gm1ih 4 жыл бұрын
Is this currently available on Cinetracer? I have the VIVE and want to know if I should buy cinetracer now? or wait till you update it
@CinematographyDatabase
@CinematographyDatabase 4 жыл бұрын
It isn’t in Cine Tracer yet. I’ll post on the Cine Tracer KZfaq a tutorial when it’s out.
@alexprzewozniak3947
@alexprzewozniak3947 3 жыл бұрын
Does anybody know if I need a vive pro for this or does the regular vive work as well? Or is it worth spending more money and get the pro for some reason?
@caferoast
@caferoast 3 жыл бұрын
Wondering the same. No one explains this explicitly haha.
@yiqingcao4508
@yiqingcao4508 4 жыл бұрын
I've been following your channel for a long time. The content is cool. Can you explain how to set up a large screen, such as LED screen as the background for shooting, because in the short term, I think virtual production may be based on the fact that the foreground actors and props are real, and the background LED is the development direction in the near future. Hope to get your reply.
@CinematographyDatabase
@CinematographyDatabase 4 жыл бұрын
YIQING CAO I’ll eventually show an indie version of LED simul cam.
@yiqingcao4508
@yiqingcao4508 4 жыл бұрын
Cinematography Database ✌️✌️👍👍🎥🎬
@DualFramesPro
@DualFramesPro 2 жыл бұрын
Can I use 4x HTC SteamVR Base Station 1.0 ? Or it should be exactly 2.0 version ?
@CinematographyDatabase
@CinematographyDatabase 2 жыл бұрын
Only the v2.0 can do 4x I believe. V1 only allows 2x
HTC Sent Me a SECRET WEAPON for Virtual Production
13:58
Cinematography Database
Рет қаралды 38 М.
Indie Virtual Production is HERE!
10:04
Cinematography Database
Рет қаралды 69 М.
Happy 4th of July 😂
00:12
Alyssa's Ways
Рет қаралды 69 МЛН
Sigma girl and soap bubbles by Secret Vlog
00:37
Secret Vlog
Рет қаралды 12 МЛН
Double Stacked Pizza @Lionfield @ChefRush
00:33
albert_cancook
Рет қаралды 83 МЛН
Body and Facial MOCAP | Rokoko + iClone
10:55
Cinematography Database
Рет қаралды 38 М.
In-Camera VFX with UE4 | SIGGRAPH 2019 | Unreal Engine
46:52
Unreal Engine
Рет қаралды 56 М.
Unreal Engine  - Attaching Vive Trackers
34:32
Jake G. Water
Рет қаралды 20 М.
Virtual Camera in UE4 Using Oculus Rift or Vive (Tutorial)
14:47
Aiden Wilson
Рет қаралды 37 М.
Dual Follow Focus + Dual Vive Tracker
17:43
Cinematography Database
Рет қаралды 56 М.
Using an iPhone as a tracker for Virtual Production
28:16
hyperbolic films
Рет қаралды 121 М.
Realtime 3D Video Production is here! (Unreal Engine Tutorial)
9:14
Indie Virtual Production | Real Time Key in UE4
11:56
Cinematography Database
Рет қаралды 92 М.
POV Joy went hospital because of Anger, but.. | Inside Out 2
0:32
CAT-N-TOON
Рет қаралды 9 МЛН
All creatures are from God #jesus #jesuschrist #jesuslovesyou
0:19
Jesus By Your Side
Рет қаралды 3,3 МЛН