Your Proxmox Cockpit NAS video was paradigm altering for my homelab, lol. It allowed me to ditch a TrueNAS Scale setup I was using and reclaim a TON of compute and ram.

Timely! I've just completed my own migration from TrueNAS Scale to Ubuntu 20.04 + Cockpit + 45Drives. Excellent!

NIce video. I recently junked all my eBay "Lab" equipment and built a vSphere cluster from enthusiast level PC components with three 4TB SSD's. It was a lot of fun and it offers a ton of flexibility. I'm now looking to swap vSphere to Proxmox, which is why I'm here. It was really nice to see someone else's journey.

My desktop drives died after reaching 10 power-on years. It was a 1TB WD Black and a 500GB Seagate Baracuda. Both were used their last 5 years in ZFS and both were cached by a 80GB and 40GB L2ARC and 5GB and 3GB ZIL/LOG based on a 128GB sata-SSD. My L1ARC had a hit rate of ~98%, while the L2ARC still had a hit rate of ~40%. So in my configuration the disks collected power-on years, but they were somewhat retired, They only had to do all the writes. Most of the reads were done by the memory and SSD caches and that is probably, why they did grow that old, a healthy and serene life :) :)

First thing, I LOVE you cat! I wished I had known you were going to do this earlier. I just decommissoned my HPE DL380G8 and sold it, and I would have shipped it to you for free. ProLiant DL380p Gen8 Dual 750W PSU's Ilo4 HP Integrated Lights-Out 2 x Intel(R) Xeon(R) CPU E5-2670 @ 2.60GHz for 32 threads 16 x 8GB 1333Mhz C3-10600 DDR3-1333 ECC Registered RDIMM for 128GB 8 X 600GB 15K SAS drives. 4 x 1gb lan ports 1 x 2tb NVME Drive in an NVME TO PCI-E converter. Used for Macruim backups. Replaced it with an DL380G10.

YES! I was soooo waiting for this 🎉

At 20:47, you stopped talking and the only thing that I could see on the screen was a cat that demanded being pet, but all the server stuff from before that makes total sense.

I have that exact same A300 DeskMini setup as my Proxmox host. Love it. Ryzen 2400G, averages ~20 Watts @ 230 V with a few VMs, some LXC and Docker containers, costing me ~€5 a month. Super quiet with Noctua fan, since it has a "real" BIOS and you can adjust fan curves, unlike with those 1 liter PCs. I have to practically put my ear on the case to hear anything. Granted, single 1Gbit Realtek NIC, only 4 cores, forced to use SO-DIMMs, limited IO and no expansion options, but so very silent and cheap to run.

That cat looking at you once in a while thinking, who the f... are you talking too :D Priceless

Can you go a little more in depth on the proxmox + cockpit setup. I am not quite grasping this setup and the advantages it provides over say something like unraid.

great video. I just got my own asrock deskmini h470 running. superb machines

Ambitious

I see The Producer is regularly inspecting the set. 😉

Four things: 1) That ProtoArc keyboard is a great idea, but it isn't exactly what I would call inexpensive. (it's a $90 keyboard and mouse combo) Great idea though. Maybe I'll get that for myself for Christmas. (I would be interested to see how well that keyboard handles simultaneous key presses (for games and such).) 2) My mass server migration event happened over Christmas last year (2022)/into January of this year (2023) where I migrated 5 servers down to 1. That took my power consumption down from 1242 W to ~570W now. (It's a dual Xeon E5-2697A v4, 16-core/32-thread CPU with 256 GB of DDR4-2400 ECC Reg. RAM and 36 HDDs.) However, the server became so busy with managing all of the data and VMs and containers (I'm upto 4 containers and 10 VMs running off of that thing, plus, it is responsible for managing two ZFS pools, for a total of something like ~200 TB of space), it became so busy and loaded that I ended up having to fire up one of my old(er) 4-bay QNAP NAS units back up, to take a little bit of the edge load off of the main Proxmox server. As of this morning, there is a new proposal that I am mulling over where I might have to re-commission my HPC cluster head node back on, because Debian isn't great for dealing with 100 Gbps Infiniband (CentOS was better at it), so I might end up spinning that system back up, so that it can be my Infiniband subnet manager. Not 100% sure about that yet. I might test it with a CentOS VM to see if the VM can deal with being my Infiniband subnet manager, that way, it will make my 36-port 100 Gbps Infiniband switch stop power-cycling the fans in the sense that it will ramp out and ramp down, roughly every hour-ish, because it thinks that the Mcast group has been deleted and recreated, repeatedly. So I will have to test that out. Unfortunately, I also know that virtio-fs (which Proxmox supports) and NFSoRDMA doesn't play nicely together, so that will be a bit of a bummer. Dunno yet. Will have to test that out. 3) re: watching your own videos back so that you can see how you did something That's what I use OneNote for. I have notes on how to do stuff (especially in Linux) ALL. THE. TIME. My cluster deployment "script" is a OneNote tab/page. My OneNote is on my QNAP server and then I've pointed my NextCloud turnkey container to it, so that I also run my own local cloud provider service as well so that I can get access to those documents without going through SMB or NFS (and I can also live-edit them with NextOffice). 4) Going from 10 to 8, then 7 servers is great. There are a few things that I know that I CAN'T migrate/virtualise: CUDA doesn't migrate/virtualise well. (GPU accelerated CFD can't find the RTX A2000 6GB, despite me getting GPU passthrough working in Proxmox.) Some of the Infiniband stuff (again, e.g. RDMA), doesn't migrate/virtualise well. So yeah. Also whilst you can virtualise the gaming systems, to connect to it remotely without paying for Parsec, becomes a LOT more limited. (e.g. I haven't found a great way to be able to play Minecraft via a virtualised gaming system, over remote desktop. The mouse inputs gets misinterpreted by the VM.)

Tks for the video! One suggestion: it would be much more easier to undertand some of your toughts if you present a diagram showing all these components. At some points in the video i feel my self lost due to the big and complex structure.

I'm looking to abandon my TrueNAS server, as well. Mainly I want to condense my 2 servers into 1, primarily for power savings. But also I'm not using Samba in my environment anymore. And that's really the only reason I'm using TrueNAS anymore. Everything else is just easier to do at the command line, on a system that isn't hellbent on being an appliance and making your life miserable if you step out of scope in the slightest.

Question about HA. I have a 3 node proxmox cluster. All of them have a 1G connection to a switch and a usb 1G usb to Ethernet for a my CT or VM different vlan. I am planning to migrate my HA from a pi to the proxmox cluster. It on another vlan, also have a zigbee dongle on thant pi. Is there a way to migrate HA and use the same vlan on proxmox whitout a nither Ethernet cable? And if something happens to the pc where HA is and migrates to another pc how can i make the zigbee keep working? Thanks

So does proxmox by default keep track of stuff on zfs liek scrubs, tell you if/when a disc fails and all those other good to know things that i've experienced that trunas does very good. If you had to create scripts for it are those shared somewhere? (i'm also contemplating skipping forwarding my raid card and all that hassle)

Regarding shadow copy - can you browse versions on macOS?

Is it possible to set this up to have it also be a LUN and ISCSI target (server)?

Can you use iscsi with the config Proxmox + Cockpit?

I want to have a all in one server with proxmox and a couple of vms/LXCs (with samba for nas usage) inside. I have one nvme x4, one m.2 key e WiFi and two data ports. Could you please suggest where to put what without sacrificing redundancy? Proxmox on one nvme with zfs and vms/LXCs and the samba data storage on both satas in raid1 with zfs? Have heard proxmox should be kept alone on one drive? I would appreciate a suggestion greatly!

What OS are you running on the TerraMaster -- TOS, Proxmox, something else? Thanks.

19:56 I have to respectfully disagree, 3 years of power on time is nothing for those drive. My 4TB WD RED started having signs of the end after having ~7,5 years of power on time...... Also so far im pretty happy with truenas scale, it does not expose docker directly but it still works pretty nicely at least for me.

You do really great videos. But I'm still confused the best way of having these 3 things: 1. Proxmox running VMs with the VMs backed up to "something". 2. A file share location which I can save and access my files from all my network devices 3. The "something" which backs up both the VMs and the file share Currently I am just running ESXi with random limited backups of my different devices, so I need to sort it out! What would be your recommendation? (Then I'll go and watch your respective videos again!)

You had mentioned something about truenas doing truenas things and wanted to move away from them is there any change they made? I am not sure what you had ment about that

"I have 10 servers in the house doing server things" 👌

What are you using to measure power consumption?

spend 15 min doing structured wiring organization - too many servers is a nice problem to have - ideally you will want 2 clusters of 3 boxes lower power cpu - i just had a raid fail so you do want dual nas to run netfs - I think that is probably the biggest thing to do for aspiring cluster fanatics - big and fast netfs with redundancy

What's the cat's name? Great video, loving your content.

Ten servers to seven ?. Not enough, should be to two!.Well, I used an X99 sever with E5 2680V4 14 core machine with 64GB of ECC DDR4 RAM. I reduced from 6 to two!.But had 14 drives and 2 NVME disks.

How did you pass through the coral to the Frigate container? (If I understood right you are using a container and not a VM?)

How do you monitor the power consumption?

The irony... I am neck deep in a migration from TrueNAS on bare metal to TrueNAS in a VM on Proxmox. Consolidation is also the reason. I was running seperate nodes for Proxmox with the baremetal TrueNAS as backing storage. Now, TrueNAS is *just* the storage/pool/users manager and everything either hairpins on the same host or connects over the network to TrueNAS. PBS backs up the TrueNAS VM. TrueNAS configs are persisted in git. VMs have local storage and shared backing storage via TrueNAS. I mostly kept TrueNAS because it does a decent job managing the ZFS pools and sharing things out. I don't care for their "apps" and "kubernetes" implementations.

Re-upload? Why i think i already saw this intro?

Fix your audio mate. It's low and feels very muted.