🕹GO WATCH GAMELINKED🎮: kzfaq.info/get/bejne/e-B_adZ0xNvPoZ8.html

I can't wait to see what the community does with all these clips of Linus on a green screen

at this point LMG should just make a channel dedicated to talking about all their channels

Andy looking around in circles awkwardly while people are adjusting his digital hair is a whole mood.

Cant believe how far Fillian has come to be featured on an LTT video! 🙌

Nothing beats a real set, but that is crazy good performance for a green screen set!

How to LAUNCH A CHANNEL but while making your normal video. This is genius. Kudos to writers 👍

Being a VFX guy who works in keying and deals with LED walls all the time, it's amazing to see this high end film tech spilling out into other content production workflows. Keying is never easy, and this is a fantastic middleground - I wasn't aware of the ultimatte kit!

Filian clip is at 12:41. It's absolutely worth watching the entire video, though, to fully appreciate how much work Filian puts into her setup.

as a vfx worker the detail on that is nuts , the hair definition and the refracted hand sanitizer and glasses is wild .. yea a cleaner green screen makes things easier but thats solid af. that would be so much work lol.. theres also a plugin for blender that does the camera data from your cell phone accelerometer

How in the world did Filian make it into an LTT video?! My worlds are colliding.

I'm sure if you guys rang up Corridor Crew you could EASILY commission them to build you a workflow surrounding this tech. The LMG staff could quickly pick up on this but Corridor has been using this kind of advancement in video production for their whole channel's life. If anything I just want a collab about everybody geeking out at having a hybrid virtual production setup.

One thing you should definitely consider is that if you have lights in a virtual background, you also need to have set lighting in roughly the same location, as the shadows on the actor would look unrealistic if it's just regular greenscreen lighting with lights in the virtual background.

The green screen live compiler thingie is honestly so cool

Filian on LTT as an example was great. The editor is cultured.

Still waiting for Emily's Linux channel.

Love how happy Linus is nerding out over all this and educating us. Thx!!

As a VFX artist, I always wondered how they did this so well live! That's awesome! Also, great to see LTT move into virtual production!

12:43 man, seeing Filian on a Linus video wasn't on my list today.

Thumbnail predicted the future

Love the future proofing of a set built in unreal. I doubt this would happen anytime soon but I wonder what it would be like to have something like this for a VR “WAN show” type thing

There is no other channel, where behind the scenes kind of videos overlap so well with the regular content.

This is a banger of an episode. It's got that typical Willy Wonka chocolate factory tour energy that I've taken for granted the last 12 years of watching Linus' team productions. At this point traditional media can't possibly hope to compete - how things have changed.

I love how much fun it seemed all the other employees were having in the background!

Props to Andy for being an amazing NPC.

If this is what we get from Linus stepping down as CEO and letting his creativeness flow, sign me up. The acting in the intro was A+ quality.

On the issue of not matching hue due to lighting: You can dual sample. The manual for the Ultmatte12 covers this at the bottom of page 41

I'm in the broadcasting / tv production industry for almost two decades now and it's really amazing to see what you can achieve on a budget these days. camera equipment 7 figures, posptro equipment 6 figures, recording equipment 5 figures - all gone. Doesn't only makes me happy because now also cinematic enthusiasts also get to make content with a high production value - I'm a line procer so it also makes my job much easier.

I respect the content LTT puts out, but I always enjoy the Behind the scenes aspect more. Like they could have a blog series about daily logistics issues and I would enjoy it more than tech news or whatever.

didn't expect the fillian clips in 12:42

This videos editing and script is a sudden and unexpected major step-up, feels like some TV people got involved into production, great job

@LinusTechTips I was apart of the Crew that helped build "The Volume" LED Video Wall for Lux Machina and the crew of Mandalorian. If your company ever wishes to explore that avenue and use LED + D5 Switchers for Motion Tracking and Integration please reach out. I would love to come down to Vancouver and help you guys set-up a legit video wall. I have contacts with ROE and various LED companies to this day. Not to mention I could help you guys get the proper rack mounted equipment to facilitate a day-to-day studio operation. Anyways, it was fun to watch this video and I am glad you guys are expanding and growing! I've been a life time fan and still work in the film industry to this day (IATSE Local 600 + IATSE Local 80 Studio Grip).

No way they used filian as the example for motion tracking

Linus is looking more relaxed and happier these days. Good job hiring his boss!

Whoever scripted this one did an amazing job. Definitely a departure from other videos I’ve seen. Really great.

Having a dedicated gaming show is amazing bc I don’t watch the full wan shows bc mostly looking for gaming news and having a full show dedicated to it from you guys is amazing.

Tom Scott did a whole game show based around this idea 2 years ago. It was called disconnected. It also used LED panels so that the actor could be accurately lit by the scene itself so they would blend in even more naturally.

Cool to see LTT finally start getting into virtual production. Using unreal or unity with some trackers or Rokoko mocap suits have become a super “affordable” low barrier entry for content creators in the short film space (like what corridor crew shows off to everyone) and especially Vtubers. Side note: absolutely hilarious that Filian is the example used XD

So it’s quite similar to what I did in LIV on my Oculus Quest…no green screen, just a spacious enough clean area, a phone stand with a studio light and my goofy ahh bouncing around in front of my iPhone 12 Mini wearing a stupid white visor. Messed around some to get it working standalone (without the VR grip tracking) and it worked out really well. Would take a lot more choreography to do something on the scale you folks are, but a whole new world of creative possibilities still lay out there for us small time

This type of thing is also done in robotics. My FIRST Robotics Competition team has been working on using a camera to locate markers called AprilTags to find where the robot is located on a field, and using that in the 15 second autonomous period where drivers can't control the robot during matches. (Though we haven't gotten it working yet, still working on the code :P)

This is cool. Nerdforge also released a video recently that shows how they updated their set to incorporate Unreal 5 and camera tracking, but with a more hybrid approach where they still have a set but render a 3D scene on a tv behind a window frame to make it seem like there is an outdoor area behind the set.

Props to andy for being the perfect npc during the greenscreen explanation 👏

So awesome to see LTT using Unreal! Looking forward to seeing more of this :)

13:35 Small note for Android phone tracking. It's best to have a built-in gyroscope (in a lot of flagship phones such as the Galaxy S but not in all android phones), accelerometer (it's in most), and a magnometer (again, in a lot of flagship phones but not all androids) for real world tracking to work properly. If you have an accelerometer it can work ok (drifts off track FAST), accel and mag and it works decently (drifts quickly but not as fast as just an accelerometer), and all 3 works great (still drifts but it is more gradual and takes a while due to how gyroscopes work)

We did virtual production years ago in Unreal for cheap with a htc vive tracker (1gen). It‘s actually really easy and allows you to realtime comp it together^^ We did this at a convention with cosplayers. Maybe 50ms latency at max. Still got the project lying around somewhere in case anyone at LTT is interested^^

I’m glad to see LMG grow so much! Edit:this is the most likes I have ever gotten on a comment

I was not expecting Filian, so not expecting Filian

11:58 literally made my day. I couldn't stop laughing 😂

Linus’ employees: Our workload is too big, I wish we could put out less videos that we work harder on Linus: I know just the thing

That plastic soap bottle demo was amazing! This thing seems to composite better than most keying filters I've played around with. Can you run old, pre-recorded footage though this thing for the same effect?

12:43 FILLIAN!!!!!!! LETS GOOO

TFO, the French public tv in Ontario has created a Virtual set a while back and actually rents it out. That could be a cool topic to show the technology. They're located in Toronto!!

I was almost expecting virtual production with giant led panels.

As a production nerd myself, I loved seeing the BTS of how you guys work on these shows! I love Blackmagic's stuff.

I think I've seen your "qr" code looking things earlier this year... If I'm not mistaken, they are called April Tags, developed specifically for fast image recognition/ processing. The competitive robotics program I run a team for just switched to them this year instead of retro reflective tape.

Super cool to see this virtual production setup. One thing, though. The example of the "TikTok" filter using body segmentation to turn the person into a colorful illustration is actually an Instagram filter... that I helped make :P

This workflow is so inspiring, reminds me of doing live video editing back in the 90s, but not at all.

Cool tech! I'm interested to see where the technology goes in the future. I also find it hilarious how at the end of the video, it says "Thursday 06/28/2023" when today is Thursday the 29th. Somebody in editing must not have been paying attention to the calendar too closely. 😆

9:50 omg I've always wanted a solid answer on how NBA and sport streams have sponsors that arnt actually painted on the court while still having players run around and it composites it perfectly.

dude, you gotta make all your in content ads this efficient, before i could even skip it, i had already been advertised to, so job well done

Here's a fun trick: if you want to get the intrinsic parameters for your camera/lens combo and they aren't available online, 3D scan some object with the camera (take photos from various angles) and reconstruct it in colmap (set camera model to FULL_OPENCV and make all images use the same camera). Be sure to refine the principle point once the reconstruction is done. You now have extremely precise camera distortion parameters you can apply to any vfx stuff you render to get a perfect match

This is such a great "intro to virtual production" video. Kudos to ya'all, great workflow.

Man. BMD has come so far from the last time I was working in broadcasting. So damn COOL!

@10:09 we had photo stations in 2002 here in Switzerland at the Expo.02 that already did that - some of these even didn't have a static background, just the view out. You'd have to move left-to-right and a bit up/down to "wipe" the entire area for it to detect what the background is, but once you did that, the result was awesome. No idea what happened to that tech, but apparently it was not that expensive even back then. Otherwise they couldn't have afforded about two dozen such photo stations to take photos and email them.

The rendered green screen backgrounds still look a bit off, but pretty darn good for non-blockbuster movie quality green screening. There's motion blur that doesn't look quite right when moving and lighting issues. But I bet as the editors work with it more it'll get even better!

New gaming news channel? Finally, a consistent source of good gaming news that can be trusted! Thanks Linus!

The BBC used more-or-less exactly the same system for the set design for the studio during their coverage of the Tokyo 2020 Olympics. There's a video on the BBC Sport KZfaq channel (not sure if it's available internationally - I'd link it here but I'm also not sure if links are permitted, though it's easily found in a search). In their explanation they say it's "the same engine which produces Fortnite", which is obviously Unreal Engine. Instead of using Vive trackers / ARKit, they used infra-red cameras which pointed up at locators on the ceiling. The end result looked really good on live TV. They still use it for the studios during other sports events, so they can easily change the set to match the event. Their video is not as technical as this, but it's still worth a watch if you're interested in this stuff.

I can see a future where the LMG studio is just a series of sound and light controlled green screen booths. I watched this video after seeing the first GameLinked episode and was impressed that they splurged on all of the (what I assumed to be Titan Tube) background lights. If the future of LMG is genuinely going to be a larger collection of smaller channels, this approach could make a lot of sense.

Filian on LTT! She just keeps wining!

14:23 ah yes… Thursday the 28th… (should be 29)

As a video professional I've been able to tell you guys we're doing green screen on a couple a roll shots for months now but it's really cool seeing the tech behind it. The fact that black magic makes something that cheap when I've been doing purpose but Rex for the stuff that cost three times the price for a decades is insane

As a big TV production geek I find this fascinating. It’s amazing how far we’ve come. I remember doing Chromakey as a teenager on Video Toaster in the 90s and this stuff is just wow.

Even tho, thanks to Captain Disillusion, I already knew (almost) everything about this subject, it's so cool to watch this thing working its magic live while you guys explain it, good luck with your new channel!

It is nice to see some more in-depth chroma-key coverage. Blackmagic Design has been and is constantly pushing production on almost every front forward.

That transition at the start was so smooth and trippy wtf

I used to use Ultimatte waaaaaaay back in the day when it was $250,000+ USD for a full setup! The CPU/GPU system usually uses 10-to-16 bits per RGBA pixel channel (40-bit to 64-bits per RGBA/YCbCrA colour pixel) and COMBINES a chroma key (i.e. choose a specific colour to key out), a luminance key (i.e. choose a specific brightness level to key out) and an Alpha Channel Key (i.e. key out objects in side of or outside of where edges occur) in order to get rid of artifacts. The Green screen is of a specific brightness level AND the CHROMA value (aka the Colour or Hue value) of the green screen background lets you tell the computer to find all occurrences of the GREEN background that have a specific colour brightness level and replace it with a still photo, moving video or computer animated imagery. To remove the artifacts on the edges, you use 2D-XY SOBEL or CANNY edge detection to find the EDGES of the person or object that is placed in front of the screen and those edges can be further examined and replaced with 2 to 5 pixels of inverse-squared blurring and pixel feathering that allow you to add any SHADOWS on the outside edges to make the front object stand out better from the overlaid still photo, moving video or computer animation that was overlaid on anything green within the background. SOBEL and CANNY edge detection are VERY good at detecting edges, but it does need SUPERIOR HARDWARE acceleration which was very expensive back in the day which is WHY in the 1990's it $250,000 USD for a Production-Quality Green Screen! Today in 2023, because of SUPER FAST CPUs and GPUs, the RGBA Chroma and Luminance keying combined with SOBEL and CANNY edge detection lets you create super smooth green-screen keys and compositing with even full motion 4K live video! It is actually REMARKABLY EASY to create your own combined Chroma, Luminance and Alpha Channel-based 2D-XY SOBEL/CANNY edge detector keyer using PURE software-based code! I coded and then put out my own 8, 10, 12, 14 and 16 bits per RGBA/YCbCrA channel version to the public domain a few years ago using C/C++, Object PASCAL and JAVA source code and MANY manufacturers now use that code in their own products! I wouldn't be surprised if Black Magic uses all or parts of my code in that box now! Now You Know! V

The one thing that gives it away as a green screen is lighting. If your on-set lighting can match the digital set it will integrate almost seamlessly.

thanks for the cameo 00:00:45

There are folks in the VR community who were doing camera tracking with regular Vive trackers several years ago in order to film mixed reality footage for streaming (like, composite their real bodies into the virtual footage from VR games). I'm pretty confident you guys could get that kind of Vive tracker working for way less than the $5000 pro ones. Might even be easier than integrating with ARkit, and it would almost certainly give better results than the fiducial tracking. Just something to think about.

I wrote software to do this sort of thing decades ago. They had taken movies of a knight in shiny armor in front of a green screen to be sprites in a video game. Obviously I not only had to have it key out the screen, but it also had to get rid of the color in the reflections. Ok, it was a lot simpler than this, and you might have had to have adjustments change per frame, but it did the job.

I think the movement definitely has to be worked on to look more convincing. It looked incredible for two seconds but as soon as the camera started doing more complex movements, it looks like the background was really struggling to keep up. Definitely really cool though.

4:44 Linus! It's called "BlackMagic" for a reason!

I was not expecting a Fillian cameo in this video.

Yo that was Filian! This is so cool!

Linus once again with his shenanigans. Looking forward to the new channel!

Virtual products are so cool! I've been fascinated with it since corridor did it. It's really interesting how it's become so accessible to smaller creatives

Virtual sets are amazing now next to what was available to us when I was in school a decade ago, and that was already really neat. I was crew on a student TV show that used a virtual set by the time I was finished, but it was all set up so that none of us really had to worry about it beyond keeping the on screen talent from getting close enough to the backdrop to cast shadows. Also one advanced production class I had I was offered a script the instructor thought would be a good use of the virtual set and he'd match my team with an architect, but we decided that learning VS stuff on top of the zero gravity stuff in the script would be too much for our shorthanded team.

I wasn't completely sold at first because knowing it's a green screen, it isn't too hard to see small details that make that obvious, but the hand sanitizer bottle thing is insane.

7:40 his hair gets more wispy on every cut!

The only problem is that the light has to match with the background scene. If you want to achieve a more realistic scene you could also track the lights in UE5. However it might still not look real due to missing reflections and stuff like that. Therefore as you said you'd need to use a very very bright Screen to cast light to the actor. Otherwise a very interesting video. I love your videos about cameras and stuff like this... Thank you for the video

I was just working with these devices In a commercial broadcast setting I appreciate the explanation of how It works and now fully understand the dirty and clean terminology they were using.

love the camera tracking parts, I do those algorithms for augmented reality

12:39 - Spotted a Raspberry Pi!

I don't think it will be very long before LTT could outsource production for other creators/companies

11:35 I have a friend who works in a multi million dollar studio with giant video wall almost like that. His cousin owns the studio and people rent rooms in it and network. They have worked closely with the Unreal Engine teams to fix issues they've encountered when setting up the motion tracking and all with UE5, the video wall, and cameras. It was insane when he showed me it all. It doesn't fully wrap around the room but it's like half way around the room.

Blackmagic is magic, there's really no other competitors that offer such a wide range of real time production tools for there prices! I would really value a bare bones budgeted complete VR pipeline ranging from a few hundred dollars to hundreds of thousands of dollars. going in depth on the best cameras, trackers, green screens, real time projection mapping with a projector or LED screen and postprocessing tools. really interesting update on your studio and the workflow.

5:01 That's impressive as hell

At least the editors used some successful Filian flips it would be pretty bad if they didn't

This tech blew my mind. The first time I saw it was on the set of Umbrella Academy s02. There's a point in the season where a bunch of the cast falls through a portal. It was the biggest green screen setup I've ever worked on with a tower wrapped in green screen for them to jump off. Walked up to the monitors to see one regular monitor and one with a pre viz of the street in the east end of Hamilton already rendered. The only thing they didn't have was the sky. It was very cool to see. Though I've done AR walls for both Star Terk Discovery and Strange New worlds and it's ever better. Also solves a lot of the lighting issues as well as adding lighting options for the DP. Try some Astera Titan tubes on those dark spots to even out the light. Always hate trying to light a green screen. It's definitely a challenge to get it even while staying off camera. Glad these things are getting cheaper, planning on using the same method for my photography. Teaching myself Blender and Unreal to build virtual locations. It was a theory but you just proved it was viable so thanks 💜

Those speakers look like portal turrets. 🤔 12:05