I'm new to this channel and was wondering... anyone else find this kinda, well, soothing? The steady, calm delivery works! Great video, really enjoyed the content.

All the stuff that you did off camera - is exactly where I'm stuck.

I built a virtualization server using Proxmox a few years back using the same motherboard and a similar 2u case a few years back. Added an old quadro w/ PCIE passthrough for video transcoding and the thing works like a dream. It's been awesome a first "real" home server, running absolutely everything I need (with exception of a separate storage server) and has had pretty much zero downtime since building. The one thing I will say for anyone looking to use this board or similar (if you can find a deal on a several year old board), that passive heatsink really doesn't cut it if you aren't in a 1u case with loud high static pressure fans. I ended up designing a 3d printed fan mount that just pressure fits on the top of the heatsink, with a 20x40mm noctua fan blowing down on the heatsink. I haven't seen the CPU exceed 50c since installing (used to hit high 90s and throttle), and everything is still nice and quiet.

Hey Jay, the proxmox team added a way to apply network changes without needing a reboot. Click apply configuration button. However, I should note that it will ask you to install a package, which will need a reboot (but only one time after installing it). Now you can make future network changes without ever needing a reboot.

Whoever may need this build guide; the part they need is exactly what happened @ 16:03 off-camera. The people that know how to do that part don’t need the rest of this video, so I’m not entirely sure who this video is for

Thanks for the video. This is bit expensive. I have used Lenovo Tiny 93P got from ebay for US$125 and changed to SSD256BM and 16GB Ram. This set up cost me less than US200. It is core i5 Gen 2 cores 4 threads and work well for over a year running a) Debian-> Docker-> Home assistant to control 200+ devices running heaps of automations b) VM to run Blue Iris on Win7 with 10 cameras + Unifi controller for my unif network. I do have a HP Gen8 server with SAS drives (4)+ 8 Code (2 process) +24GB system configred proxmox but not running it as it uses over 250w and my Tiny PC uses less than 40w (my network rack use only 75w with Tiny 93P+ Synology 213 NAS+ Unif USG+ 2 PoE AC-Pros+ Modem+ Netgear Switch+ 3 Hubs for energy monitoring and home automatons). I am sure your system use more than 50w. So there is cheaper ways to get thing going and that does not need lot of power.

Hi NewYorker. How are you doing? I do hope the Corona virus has skipped over your household and that of your close family. I must say that I follow your presentations as a matter of course. I am a retired old IT guy, with limited need. And that need is to enjoy watching talented people like yourself. Regards from Montreal, Canada

@9:15 the IO-shield is not so much about airflow (notice that in your case you have a large vent right above it) but for EMI shielding. Also, if power consumption is of concern I'd rather use a PSU with Gold or Platinum rating. Especially under partial load those are much more efficient. Alternatively: dont oversize the PSU that much. If the system is only going to draw ~50W you're better off with a PSU in the 150-200W range, as it will run closer to its most efficient operating point (usually around 50-60% load). @30:45 the updates you get without key are those from the base Debian system

Wow. I never knew that you could mount ISO images in the Supermicro IPMI. Thank you!!

Please note that usually when a server part (CPU, HBA, NIC...) comes with a passive heatsink it doesn't mean that this is enough but requires some amount of airflow to be properly cooled. I strongly suggest you to check the CPU temperature because if in idle it should be fine, I can almost guarantee that under load at 55W and without any airflow it's thermally throttling like crazy!

I would add a few case fans with that board so the CPU doesn't overheat. Those fanless boards are designed for 1U cases with push pwm airflow

Did nearly the same setup like you with AMD Ryzen 2000 CPUs, not much power consumption and samsung NVMe's. You should always buy the pro versions when there is a lot read/write activities on it. It is so powerful that you are able to run multiple Windows Servers (+ Domaincontrollers) without any issues. Great for smart comercials.

I also did 55W 4 years ago, but i went for cheaper option. I am using ASROCK j1900 motherboard with 16GB of ram, the TDP of the CPU is 10W. To that i added 1tb HDD for proxmox and 3x 2tb for ZFS NAS, currently on openmediavault with sata passthrough. I have added a second NIC to access two networks because i did not wanted to go VLAN, and recently a 5th HDD, it's a 10tb drive for cctv and computer backups. I am waiting for mini pcie SATA card to attach it, currently it is on USB adapter, without the 10TB i measured it to be also 55W with 4 HDD drives. I am planing to replace it as soon as i will purchase a solar power installation with my HP z620 workstation with Intel Xeon 12 thread CPU and 16gb of ram. The cpu is 10 times weaker than yours but it was fine even for plex transcoding from 1080p. And i also run Proxmox ;). For network i went Mikrotik, with HEX S as a main router (because of it's 450mbit/s ipsec performance) and two RB951 series for WiFi and i am waiting for hAP ac2 for my main wifi since those two are meant to serve all the smart things in my house.

Nice server. You can do this on a budget if you go with used server parts from ebay. Or to do it cheaper and really low power, do it on a Raspberry Pi 4. The model with 4GB of RAM can host six or more containers. Under $100 and 5 watts. The Self-hosted podcast is a great source of info. And Rapberry Pi are the only way to build a cluster without going broke.

Can we expect a follow up on how this server has been doing since installation?

I've just built something similar some months ago: 5 x 512GB M.2 SATA SSD (PCIe-Board), 4 x 4TB WD Red, Supermicro X11SCL-IF with IPMI, Core i3 9100F (4 Cores), 2 x 16GB ECC and be quiet! Pure Power 11 400W PSU within a Fractal Node 304 case. My system idles at *22 Watts* and is pretty quiet. Services running as LXCs on Proxmox: haproxy, mqtt, influxdb, node red, grafana, nextcloud and gitea. The systems will get two additional backup drives attached to a M.2 PCIe 2 x SATA controller soon (waiting for the M.2 controller board to arrive). The backup drives are only powered up when a backup is due to keep the power consumption low. The power consumption is even so low, that it doesn't draw power at all when the CPU throttles down thanks to the caps within the power supply. This seems to confuse my CyberPower UPS :) (I have the suspicion that their PowerPanel software has a division by zero bug). Currently I could bridge power outages of about 4+ hours. I built this system because my previous HP ML330 G6 Xeon with 5 spinning drives drew 105 Watts (not that bad actually for such an old and huge system) and was awfully loud. It's great that it's finally possible to build such real low power systems - even with nice headroom (the above i3 has some punch when needed - not as much as your system though). The long UPS times are a nice side effect to the lower energy consumption. The nice thing about the motherboard is its built in IPMI/BMC as yours seems to have as well.

For arround 200-300$ you can buy Fujitsu PRIMERGY TX120 S3P. Small Form Factor, Xeon cpu (like ex. E3-1265L), ECC Ram, 4x2,5'disks bay, 2xGbps nic, remote access. I think its even better deal than HP Microservers.

Wow this is fantastic I’m in the planning phase of upgrading a clients existing HP DL360 G8 servers. Now I’m thinking I may build them some. Also planning on moving them from ESXi to Proxmox. Thanks for sharing everything.

Hi. I built myself a proxmox home server with a AsrockRack X470D4U and a AMD Ryzen 5 1600 6x 3.20GHz (Passmark Score: 12512) with 32 GB of ECC memory and two Micron enterprise SSDs. It uses a 92W passive cooled PicoPSU and an external power converter built for LEDs. It runs at 25W when the OS is idling and about 40W under load. 😎😎😊

@1:22 55W here is the TDP, which stands for Thermal Design Power (or Point). You can't use this as a power consumption/usage value. It's a completely different characteristic.

For common home use is enough to use old laptop with i5 or i7 and 16GB or even better with 32GB of ram. It will be much more cheaper and is a good start. You really do not need to spend 1K$ to start. Just make sure that the processor is normal M, H or HQ version. The ultra low power U versions are not very good for this task. Proxmox is definitely what you want to go for. Its easy to use free and stable. PS I am using i5-3230M with 8GB RAM and 500GB HDD and it is working 24/4 for a year with no downtime with 3 VMs and several containers and have still overhead for more...

I got exact same chassis as yours. Sadly it's the most terrific build experience ever.

I have build a more budget friendly proxmox host with a ryzen 5 2600 last year. Running my nas, homeassistant, docker-host and some test vm's. I am very happy with it. Nice video!

I keep coming back to this build! Nicely done.

I forgot low power AMD EPYC SoCs existed! Also, I can't remember when in the video you mentioned that ZFS isn't for everyone or something along those lines, but that reminds me of why I used BTRFS. It's hard for me to believe that I initially decided on hardware RAID when building my first custom NAS, but used BTRFS RAID instead, and when the secondary SATA controller on its mainboard died, I was still able to recover my data on another mainboard thanks to myself choosing to go with software RAID instead of doing it in hardware. That does mean I replaced the mainboard in my NAS, but because the rest of the previous mainboard still works, I was able to repurpose it in a different case with different components as a secondary always-on PC, that just like my NAS, runs regular Debian, but unlike the NAS, has a limited set of components in order to free up more system resources since that second system would just run one specific service, whereas the NAS runs multiple services and even a full Trinity session over a VNC connection.

you can always sacrifice compute power to save energy. it all depends on your use case. in this case, you can even do with a Rpi4 cluster.

@2:54 minor nit-pick: "order of magnitude", unless explicitly specified otherwise, is factors of 10. 11690 is not even one order of magnitude larger than 4338

Great video thanks, so into low powered labs at the moment perfect for always on workloads

I use and used ZFS on cheaper Silicon Power SSDs; one 128 GB SATA-3 and one 512 GB nvme. I never had any issues and in both cases I booted Ubuntu on ZFS from the SSDs. The SATA SSD was running in a 2008 HP dc5850 (Phenom II X4) through a $8 SATA-3 PCIe card on PCIe 2.0. The nvme SSD (3200/2300 MB/s) was running on a Ryzen 3 2200G on a $60 B450 motherboard. I'm using and boot from ZFS since 2018! I even use ZFS on my backup server with 2 IDE HDDs and 2 SATA-1 laptop HDDs all in raid-0 to maximize space and used for ~1 hour/week :). The backup server boots from the raid-0 (IDE 250 + 320GB; SATA 2 x 320GB); is in use since June 2019 and it is a 2003 Pentium 4 HT with FreeBSD 12.2. ZFS is rock solid and runs even on my potatoes!

I have a vmWare ESXi 6.7 virtualization server running since 2015 now which only consumpts 17W with 4 vms running simultaneously (2x win10, 2x ubuntu). (CPU i5-4590T, 8GB RAM, 2128 GB SSD Storage, 90W PicoPSU, Asrock Z87E-ITX Mainboard in an Kolink Satellite Mini-ITX case)

Now I know where my internet comes, from LearnlinuxTvs "internet ports". Awesome mainframe.. Todays small componet's are great but of course I like "real" servers, big ones! More noise and SAS is like scsi; making confusing situations when some things error oculus Colosseum kevyttoppapuku kurva happens..

Thanks for the video! I plan to run servers for virtualization eventually. Videos like this one give me ideas on how pick out the hardware.

Heh, I did pretty similar to this build myself. This was pre-Epyc so I'm using a Supermicro A2SDi-8C+-HLN4F instead but it's a pretty low power setup. CPU is 25W TDP, whole thing with four hard drives and two Raspberry Pis attached via USB only eats around 60W of power. I've been very happy with it, and I might've gone with the Epyc board (perhaps with a lower core count at a lower cost if available) had that been available at the time.

If im not wrong, the reason you don't have any output when joining the cluster is because the http certificate is changed on the server who join the cluster (it is replaced by existing certificate of cluster). Anyway good video, i order this motherboard today

Great build. Why not use a Noctua fan and a bigger case? You can increase your power consumption and number of threads as well by a tiny bit without affecting noise or electricity bills significantly.

Jay, if you were building this VM server today, what components would you use? Any feedback would be great!! I appreciate the videos!

i have a passively cooled virtualisation host, at max it was able to run a minecraft server with 4-8 players and 276 Mods, now its just running a webserver and mailserver. Im Saving up for an epyc build, in the next 2-3 Months i hope my little HDD and SSD dont fail XD

This! This is exactly what I look for in good content!

Perfect Video! If you could please have a tutorial about the Proxmox replication between two servers and if one is down how to automatically switch the VMs to the other one.

Thanks for this type of content, they are very insightful!

TDP is not a power consumption, is amount of heat which CPU produce on max load

Wow...Awesome stuff but good lord...that price...... Anyways, didn't know they had a mini-ITX with 4 RAM slots... 4 GigEthernet ports... I am seriously thinking about this for virtualization as RAM was always my biggest limitation. The case pretty fuggggly... Will probably use a more aesthetically pleasing case.. Thank you for the great info/find!!!!

since this case doesn't have proper front to back airflow, cardboard air duct between front fan and motherboard should drop temperatures without adding more fans

Hi man, nice! You blurred out the mac address of your nics from IPMI but not from proxmox :) Notice also that now netword does not need reboot if you use linux bridges, just install package ifupdown2 and the GUI of proxmox will apply all the changes without reboot(finally!!!)

I know this video is old but I was wondering what equipment you might recommend instead now in retrospect.

Cool video! But I think that the price performance ratio isn't good with the M11SDV-8C-LN4F

Enjoyed low energy virtualization and low energy storage server videos. Is there a reason not to do both in the same hardware? If not, maybe a video on a combined machine? Case and MB suggestions in particular.

The sticker with the password is a consequence of a relatively recent law in California mandating use of more secure default security settings. Given manufactures have to use unique passwords there they might as well do it for everywhere.

The EPYC Embedded 3251 has a controller ethernet 4*10 GbE integradted but on the supermicro motherboard they have just put 4*1 GbE by adding an i350 ethernet controllers

Hello Jay, thank you for this content. Could you please share your approach for backup Proxmox server settings and how restore them in case of storage failure. Thank you.

I would love to build this, lots of uses for this machine.

@8:38 Although it's a passive heatsink, the system should have adequate airflow going through the heatsink. Chassis fans are required for that type of heatsink. You just can't run it hoping that passive airflow will be adequate.

You need an actively cooled cpu. These types of heatsinks are for cases that have a high throughput put of air from front to back. I believe this motherboard is designed for small 1U Supermicro cases.

Thank you so so much for this video! I wacth always your video

One if the best presentations I’ve ever seen for a straight up Proxmox build. But lordy! The pop up ads were annoying. There were nine in a 38 minute video. Seriously? I can appreciate the need to monetize. I’m completely good with that. But KZfaq is certainly doing you a disservice with the number they’re auto injecting. I almost abandoned your presentation twice because of the interruptions every 3-5 minutes.

Very good. Any chance to see a Proxmox video tutorial series? Thanks

Great video. I am not sure if your power usage info is correct. 50W is very low and only a machine like Lenovo Tiny will come close to it. My Tint M93P with 16GB and 256GB SSD with no CD and one NIC uses about 40W. Core i5 4570T is rated 35W. How much power your Dell was using? Are your measurement power usage monitored from power plug. I have all my devices connected via Sonoff P2 plus with Tasomta -> Home assistant. I am planning to migrated to a Dell Optiplex 7040 Core I5-6500 rated 65w so based on what you are saying that low end SFF will use more power than users (In that I have Nvme drive). I do have HP ProLiant DL380 G7 Server 2x Xeon L5630 2.40GHz 24GB RAM 4x 72GB SA and has two power supply of 360W but I have not tested power usage. Could you kindly measure your actual power usage for the server as I cannot belive with cooling fans etc yours can be 50W

Got an AsRock A300, with a Ryzen 2200G APU, 16GB 3200MHz RAM, 512GB m.2, was just a couple hundred euros. With a couple of VMs running it's currently clocking in at 14-16W on the wall. Me wanting to get something "slightly more powerful" than a Pi3B+, and still keep the power low, definitely succeeded I'd say. Sure, with this Epyc you got 8c/16t, quite a lot more than my 4c/4t, and you got more expandability as well, seeing as the A300 only has 2x m.2 & 2xSATA (for 2.5" devices). :p - However, there's m.2 to 4x SATA adapters out there, so if I ever need to then I'll look into getting such one, and then figure out something about powering them.

So, now that you're almost 2 years in, how did you end up liking the AMD Epyc 3251? I liked this build and was thinking of using the board for a similar project. It's a nice combination of power efficiency, upper RAM limit, and compute. Anything new catching your eye?

Not trolling, genuinely want to understand the thinking here ... I'm not quite sure why the drive for low power here? - the cost difference shown for running those cpus was only $4 per year and the spend of $300+ on the new CPU doesn't seem to stack up as a cost driver. As comments call out, that board costs a fortune. So, I'm interested to know why the driver for low power usage here. If its eco friendly, suspect you could plant a lot of trees for $300. So if the old one was all good and working, not sure I get the push to swap it all out, but have low power as a major selection factor.

No joke that's so fucking near to something i thing about making. Nice to see, because im kinda new to linux.

Nice video, thank you. How about remove a node from cluster?

I wonder - How are you CPU temperatures? I just got the same board and seeing (what i think) is too high temperature of around 80c, I just ordered a "Noctua NF-A6x25 PWM, Premium Quiet Fan, 4-Pin (60mm, Brown)" and going to see if that will help. I tried a 4cm same fan and that reduced the temperature to around 32c

You should NOT have a problem with using those sumsung SSD's with ZFS. I have quite a few of them in different vdevs under ZFSonLinux.

Great video! Keep them coming.

What a fantastic video thank you so much I so want to make a Virtualization Server now.

that haircut fits you perfect jay! great video by the way, excellent as always

I run proxmox also and this video is great. However, i looked up the price of this board and wowza. It's not a cheap one! My proxmox runs a Ryzen 2400G and for my purposes it works exceedingly well! Furthermore, will the cpu run cool being passively cooled? Especially under load?

so many great things about this video, thank you so much

Any new server MB must have at least one SFP+ cage or a 10GB RJ45 NIC. There are many that don't and all those should not be considered. PS: People complaining about the price tend not to understand that an 8-core CPU is included in that exact price. Sure, you can build a much cheaper and more capable Ryzen 2700 (65W TDP, but you can undervolt and undeclock) on a B350/450 MB, but you lose IPMI and ECC RAM support, which are well worth the cost.

This was great! I learned something new, with networking.

I am looking to install Proxmox for the first time and rather confused about drives/storage. So far I think I need 3 types of storage. 1) The boot drive which could be a USB but thinking M.2 SSD. Not too sure how big though. 2) ISO and template storage. I have heard that can’t be local. Not sure why I can’t put ISO images on my M.2 boot drive. 3) VM hard drive. I am thinking a pair of NAS hard drives with ZFS/RAID 1. Any thoughts or suggestions? I am looking to run Docker, Kubernetes and other developer tools for learning.

Watched a few of your vids today, i like your style. Id puff this joint with ya for sure. And respect on the retroarch boxes...i have one in each room as well =)

I've been waiting for the next gen asrock integrated motherobards with increased pci lanes for about 2 years now. could buy a super micro equivalent today, at x4 the budget

OmG where did you get the board, 700$ is not cheap - i build a ESXI VM Server for 500$ on Rycen Platform in the same formfactor with also Low Power Usage.

I hope to see this server put to work and monitored to see where it’s limits might be..

Awesome, can u make a video how to use proxmox to set up 5 server inside? thanks

Thanks Man. Very good vídeo. Already subscribed. Proxmox runs like a charm. I dont know some many people uses other things like xcp-ng or unraid. This was my First video of yours, and i dont know If you already make some about, but i like to view something ok CT for proxmox, like domain-controller, or file server....

Love the channel :) FANTASTIC

You mentioned you finalized on a 1TB SanDisk Extreme Pro (NVME) but in yout install setup your using the samsung SSD Drive? So which are you using and installed proxmox with? Reason I ask, proxmox is failing to install at the the first stage of clean up root disks 0% complete. When using the NVME SSD drive as the target hard disk in the proxmox install. Basically, the install fails and the machine reboots.

Thanks for a very useful video. I can't seem to find the link you mentioned at the end of the video about the new hard drive, there's nothing about hard drive in the notes or in the parts list that you shared.

I"m in the process of using old dell poweredge servers for my home lab. They're pretty cheap but suck up a lot of juice.

I have a HP DL360e with 2 CPU's, 24 G, 2 SAS drives and a RAID controller with 2 power supplies...runs at 89 watts according to ilo. and it's quiet. Cost me $300 CDN

great video man!

awesome video! very insightful. thanks for sharing.

It would really be intersting to know what the real power consumption of the whole assembly is. Has anybody measured this?

The things you chose to do off camera would have been interesting to me.

Curious, I've been using Samsung SSDs (including 850) as my ZFS root & boot device (probably for years) without any errors reported. Both my current Proxmox servers are similarly (e.g. ZFS root on Samsung 860 pro 2 TB SSD) set up.

How much does this cost to build normally? Prices are insane right now

Great intro. And, great content, too, as always.

I wish i had one of these

I run it on a Intel i5 NUC and i haven't measured it from power consumption, but it's small, silent, and had a good WAF (womans acceptance factor)

a wonderful video!! thank you so much! what is your opinion about unraid?

Epic, Thank you for the vid!

Nice! Can you do a video like this one for a Low power PXE Server?

How do they work out that yearly running cost of 9.13, I realise it may not be at 50w 24/7/365 but if it was that would be 438kw per year, which in the UK would be closer to 150dollars.. is electricity crazy cheap in the Us ?

If i had a tree made of solid 14 carrot gold, i could afford it

umm, drives are not listed . i have a am3+ 8320 so with 32 gig you can run 12 vms on a 8 core ty for this. I want to run openmediavault(nas) ,ipfire,pi-hole,htpc will try with v7 of proxmox at some point as right now i only have 12gig ram, 1 ssd120gig,1 1tb media disk,320gig hd vm,iso

I’m just wondering why an efficiency build uses a low efficiency power supply? Why not 80+ Platinum? Couldn’t cost more than that motherboard!

I like your videos thanks for every moment , please make videos about freeNas