DAS, NAS and All That Jazz: Storage Strategy for Our YouTube Channel

No video

DAS, NAS and All That Jazz: Storage Strategy for Our YouTube Channel

Рет қаралды 2,951

Күн бұрын

With about 50 terabytes' worth of video files created and shown over the last decade here on our KZfaq channel - and frequently plumbing older videos for new insights -- a strategy for fast, reliable, high capacity storage has become critical. Here's how we do it. A big shout-out to #SanDisk for sponsoring this video! Check 'em out here: bit.ly/4aNFZnO
SIGN UP FOR ONE OF OUR 2024 STREET PHOTOGRAPHY WORKSHOPS in New York, Paris, Berlin or Tokyo! Visit www.3bmep.com/... to learn more.
Sign up for live, one-on-one video sessions with Hugh on Zoom at www.3bmep.com/b...
JOIN US ON PATREON: / hughbrownstone or by making a donation directly via PAYPAL to www.paypal.me/...
WE WON A 2023 WEBBY! Watch our award-winning series with B&H, "The Art of Street Photography with Hugh Brownstone" here: • B&H x Hugh Brownstone
[SORRY, SOLD OUT!] Order your copy of Streets of New York, The Book at www.3bmep.com/b....
Get your official 3BMEP swag at 3bmep.threadles...
We recommend B&H (bhpho.to/3efywkn) , Adorama (bit.ly/36twavI) and KEH for all of your photo, video or audio needs.
FREE TRIAL OF EPIDEMIC SOUND: visit share.epidemics...
Follow us on social media:
Instagram: / hughbrownstone
Twitter: / hughbrownstone
Like, subscribe, share, add to a playlist, or join the conversation below. Join Consider making a small contribution directly via www.paypal.me/.... Please support our work by using our no-cost-to-you affiliate links to B&H, Adorama, Amazon, and KEH below:
In all cases, thanks so much for being part of our KZfaq community and supporting what we do.
=======================
Gear Used to Make This Video:
=======================
- Camera: geni.us/aTHQt1
- Lens: geni.us/lX9L
- Microphone system: geni.us/Rc3gN
- Lavalier mic: geni.us/8BCoi
- Usual Audio Recorder: geni.us/SXslK
- Usual Microphone: geni.us/DkaH8uR
- Accessories: geni.us/k1YCB
- Key Light: geni.us/BGAw
- Key Light Modifier: geni.us/HObbjo4
- Fill Light: geni.us/yEA9
FULL EDIT SUITE
- Main Computer for editing geni.us/oIYLUA
- Secondary RAID system: geni.us/7GPqOV
- Primary RAID system: geni.us/C7fDV5
- Laptop for writing: geni.us/ccCt
=======================
*We are a participant in the Amazon Services LLC Associates Program, an affiliate advertising program designed to provide a means for us to earn fees by linking to Amazon.com and affiliated sites. We are also part of the B&H, Adorama, KEH, Epidemic Sound, Peak Design, DJI, Audiosocket, Skylum, and smallrig programs.

Пікірлер: 31

@mikelyon5595 2 ай бұрын

Just for an exercise In perspective. In the late '80s, TRW moved three terabytes of data sto rage from South OC out of California. It required two full-size tractor-trailers!

@3BMEP 2 ай бұрын

Love it!

@EELinneman 2 ай бұрын

Hugh, I've been doing cloud for 15 years and ran the largest AWS project at Microsoft in the past. I now run the cloud for a global consulting firm. I have multiple NAS at home for redundant storage of my RAW images and use Backblaze as my break the glass DR. It took forever to upload and it will take a while to download, but it is affordable, trustworthy, and very likely to outlive me.

@3BMEP 2 ай бұрын

I use it as well for precisely that reason, Eric! Took a week or so for the initial upload!

@nunyabidness8870 2 ай бұрын

If your dryer isn't performing well and it has been a long time since you have had your dryer vents cleaned out, please do it. It is maybe the biggest easily preventable fire hazard in the home now that we have LED christmas lights.

@photoPXL 2 ай бұрын

Really well done Hugh.

@3BMEP 2 ай бұрын

Thanks, Kevin!

@MoffatCreative Ай бұрын

Hey Hugh - I agree with many of the principles you have in the video and will not wait for renders. About parallelizing storage... a couple things - if you keep a storage arrays on separate TB controllers, they are effectively independent. Not that you are going to saturate a TB link with an 8-bay HD (200-250MB per second x 8 disks peaks at less than a third of a TB channel), so I think it isn't a problem to be concerned with. Some Macs allow for this explicitly with four externally accessible TB controllers - certainly the MacStudios do, and the older iMac Pros did. I got a refurbed Mac Studio from Apple's site partially for the TB ports with their own controllers. (and after I got a bottom-of-the-line M1 Mac mini to compare it to my Top-of-the-line MacBook Pro...i9, Loaded to the gills, and the M1 MacMini rendered the same projects on the same external storage 75% faster. ugh. bye bye (intel) MacBook Pro. My slightly different approach: for editing current projects I am using 4x2TB NVMe blades in an OWC 4m2 (RAID 0) (peaks around 2.5 GB/s), because my next level of storage is 8- disk, RAID 4 (a bit faster at reads than RAID 5; better for editing video) (peaks around 2GB/s) array spread across two OWC Thunderbays for recent projects (we chatted about that a couple years back) which contains 84TB of usable storage, and then long term storage is in dual bare disk sets (RAID 0, in duplicate, one set offsite) (500MB/s) that I can drop into a toaster-like dual disk dock over USB if I need to bring up projects from 2016, for example. I find cloud storage waaaaaaaayyyyy too slow. Luv ya!

@3BMEP Ай бұрын

Great input, thanks for sharing

@slaidaniel628 2 ай бұрын

-Thank you!

@3BMEP 2 ай бұрын

You’re welcome! 😊🖖🏻

@stephensears7483 2 ай бұрын

The other advantage of a NAS is backing up to a second off-site NAS, to adhere to the rule of three copies of your data - two different media with one copy off-site. I keep a NAS at home and a NAS at the office. These mirror themselves in real time. That data is also backup to a paid cloud every night. But by being open to the internet, constant security vigilance from bad actors is big disadvantage.

@markussidler1112 2 ай бұрын

I have formatted two external USB4 4TB SSD with Raid 0 on my Macbook Pro m1 via two Thunderbolt4 ports and then had over 5000MBs read and write speed with an 8TB drive

@3BMEP 2 ай бұрын

Love it!

@peterannear 2 ай бұрын

Hey Hugh, I like what you've laid out here. It's though provoking and well thought out as usual. I am a huge fan and a supporter. However..... I am a bit disappointed that you've published a story about storage and taken paid promotion from Sandisk without mentioning the "issues" with Sandisk SSDs that have affected many users and been widely reported. It feels like it's not consistent with your personal brand. Again, this isn't a gotcha or an attack. I'm just interested in your thought process here. peter annear

@3BMEP 2 ай бұрын

Hey, Peter. Thanks for the heads-up. I know absolutely nothing about Sandisk SSDs - I only had excellent experience for many years with my G-Speed Shuttle, which is why I was happy for them to be a sponsor. I guess: more diligence in the future. Again, thanks.

@DanDill 2 ай бұрын

How do you find the noise level of your RAID systems?

@3BMEP 2 ай бұрын

Sufficiently loud that I power down my entire system when recording videos; otherwise, a non-issue when writing or editing.

@DanDill 2 ай бұрын

@@3BMEP Thank you.

@ab185 2 ай бұрын

I went the Synology route with a 5-bay DS1522+ currently filled with 4x20TB drives and a 10GbE network expansion card. 700MB/s read/write speeds and 54.5TB of storage space with single drive fault tolerance for $2500. Getting it all setup wasn't too hard, but also not a super simple plug-and-play solution and lacks TB3 connectivity. Would require a 10GbE home network to take advantage of those speeds too.

@3BMEP 2 ай бұрын

Thanks for sharing! 😊🖖🏻

@charbax 2 ай бұрын

Are you planning to get a 10GbE home network, and plug in the 10gbit/s Ethernet adapter to your laptop/desktop to connect to it at full 10gbitps speed?

@3BMEP 2 ай бұрын

@@charbaxnot necessary for what we do, so no - at least, not yet. 😎

@ab185 2 ай бұрын

@@charbax if that question was to me: already have a 10GbE home network and 10GbE TB3 adapter for my laptop :) if that question was not to me: