A Computer Cluster Made With BROKEN PCs
Рет қаралды 197,346
Күн бұрынGet started using Notion Projects for free, and unlock the power of AI for only $10 a month: ntn.so/hardwarehaven
► Using OpenSSH Keys: • Getting Started with O...
► Techno Tim's K3s Guide: technotim.live/posts/k3s-etcd...
► Techno Tim's Rancher Guide: technotim.live/posts/rancher-...
---------------------------------------------------
Music (in order):
"Hardware Haven Theme" -Me ( • Hardware Haven Theme M... )
"CRENSHAW VIBES" - GARRISON ( / garrison-brown )
"Sunshower" - LATASHÁ( / best-music-pro.. )
---------------------------------------------------
Gear I Use: (affiliate links)
Recording Gear
► Camera - LUMIX G7 amzn.to/3LmfGdk
► SD Cards - SanDisk Extreme PRO amzn.to/3BPXrd1
► Capture Card - EVGA XR1 amzn.to/3Bn8qt7
► Studio Lights amzn.to/3BnYrUd
► Microphone - Shure SM7b amzn.to/3BP0TEB
► Interface - Presonus Quantum amzn.to/3QVeX3T
► Teleprompter amzn.to/3BxcN50
Servers and Networking
► My Remote Editing PC - amzn.to/3J1hN5g
► DriveStor 4 NAS - amzn.to/40R5LDz
► 2.5 GbE Switch - amzn.to/43unwub
---------------------------------------------------
Timestamps:
0:00 Building a Kubernetes Cluster From Broken PCs
0:52 The Lenovo ThinkCentres
1:45 What I'll Be Doing
2:30 Notion (Sponsor)
3:50 What I'll Be Doing Cont.
5:20 Provisioning The Nodes
6:02 SSH & Ansible
9:54 Installing K3s
12:23 Running Rancher
14:47 HA Storage With Longhorn
16:03 Testing Longhorn with Minecraft Server
21:50 Results
22:15 Power Draw
22:58 Recommendations and Conclusion
@TechnoTim 10 ай бұрын
Thanks for the shout out! Happy to help! Also, Techno Tim sent me to a real expert!
@HardwareHaven 10 ай бұрын
😂😂😂
@vermiumsifell 9 ай бұрын
Heyyyy
@ColinUniverse 10 ай бұрын
I always get so excited when I get the notification that Hardware Haven has posed a new video
@HardwareHaven 10 ай бұрын
Well hopefully it doesn’t disappoint haha
@SortofGoodwithTech 10 ай бұрын
Same
@ColinUniverse 10 ай бұрын
@@HardwareHaven it never does
@NyneIX9 10 ай бұрын
Well, these guys made me realized I'm not even subscribed! I've just been binging this channel. SMH
@lowbarb 10 ай бұрын
My man! Just ordered 2 of these on Wednesday and will use this video to build my cluster 🙏
@HardwareHaven 10 ай бұрын
Nice! Just know you need at least 3 for HA
@TrondClemensen 10 ай бұрын
I've been wanting to do something like this for a good while now for my own home server/lab, and with this video you answered most of the questions I had! Thanks a bunch!
@GamingAmbienceLive 5 ай бұрын
what for, it seems cool, but like completely useless in my opinion, give me legitimate 5 reasons why id want this
@JasonsLabVideos 10 ай бұрын
NIce, glad to see you showing how its all done, and that you followed some of Tim's stuff !! Good work !
@HardwareHaven 10 ай бұрын
Thanks 👍
@christianhilbrands9285 9 ай бұрын
The things you did are good for a first setup but i have some tips: - make use of projects to add minecraft servers. In a project configuration you can tell how much resources a project may take. We have projects for our buildserver and management seperate so you can give for example someone access to the buildserver project but not to it's management project. - do for example the minecraft server in it's own namespace. If you do that it becomes easier to filter for it.
@Ghaithcontent 9 ай бұрын
nice work For 6 months I have been searching for ways to implement this work. Please continue and show us all the ways that lead to the work of cluster and supercomputers.
@JMassengill 10 ай бұрын
Your production values are always great. I haven’t figured out a need for Kubernetes yet. Maybe one day.
@HardwareHaven 10 ай бұрын
Thanks! And yeah me too honestly haha
@First_Grafter 10 ай бұрын
Your videos are getting ready high quality! I really enjoyed watching this
@HardwareHaven 10 ай бұрын
Thanks! Also, I saw your message on patreon. Feel free to use my tracks, just link the video 👍🏻
@chrisumali9841 10 ай бұрын
Thanks for the demo and info, have a great day
@majesticblasian651 9 ай бұрын
I didn't have a clue what you went over on this video (b/c im new to all of this myself) but it looks very interesting. Keep making these type of videos because you seem to be more knowledgeable than what you put yourself to be.
@alexlexo59 10 ай бұрын
I'm always excited when I get notified that you've uploaded a new video
@thatnerdydev1511 6 ай бұрын
Thanks for this very hands on video. I stumbled on to K0S which is "supposedly" even lighter than K3S and just as easy to use.
@ZTK-RC 5 ай бұрын
I bought 4 of the M75Qs and loved them so much I bought two more and then four M75Q G2s for the new production cluster. Four of them are as powerful as my single Epyc 7402p that has 180W TDP, so they actually use less power and cost much less! I use them for kubernetes clusters that I deploy with PXE booting using my unify/synology setup and configure with ansible.
@jordantheman25 10 ай бұрын
Tough day, but your vids always get me inspired! Love it!
@HardwareHaven 10 ай бұрын
Love to hear that ❤️
@LeoLijo 10 ай бұрын
Great video as always
@HardwareHaven 10 ай бұрын
Thanks Leo!
@pamus6242 10 ай бұрын
Videos like these is why I am subbed to this channel.
@WillYouVid 10 ай бұрын
GREAT IDEA BEEN THINKING ABOUT THIS FOR A WHILE
@CarlSargunar 10 ай бұрын
Fantastic - great video, enjoyed the video
@100daysofmeh 10 ай бұрын
Public service announcement: Jeff Geerling is giving away his ansible book. Literally the best way to learn.
@haydenc2742 10 ай бұрын
Cool beans...I really need to do this as well..pretty darn cool! Keep em coming!!!!
@HardwareHaven 10 ай бұрын
Thanks! Will do!
@VoodooGTR3 10 ай бұрын
Loved this video. I am always curious on how this equipment works. I have not done a deep dive into it at all. But the day I do, good bye wallet. I enjoyed the video and subbed immedietaly.
@LampJustin 10 ай бұрын
Setting up the storage as RWO was totally right. The only thing you got wrong was that you'll need to create a StatefulSet(sts) instead of a Deployment. That's because with a StatefulSet a pod replica is bound to a PVC. So when you do a rollout restart it will wait for the PVC to be unmounted before starting the new container. By setting the PVC to rwx you'll also lose a lot of performance, because it will share the volume via NFS...
@HardwareHaven 10 ай бұрын
Ah, thanks! Appreciate the help!
@danilfun 10 ай бұрын
With stateful sets there is a different issue: you _have to_ use several replicas. K8s guarantees that in a stateful set there will never be 2 pods pointing to the same PVC. So if a node dies, k8s will never replace the old pod, because it can't successfully terminate it. This is fine if your app natively supports clustering. For example, if you can run 3 replicas of minecraft server, each with its own unique disk storage, but with synchronized state, so if one of them dies, the remaining 2 will continue handling requests, and clients won't even notice. Databases usually have support for this mode. I'm not sure if minecraft server does. For stateful workloads that don't support clustering natively I'm yet to figure out something better than a deployment with a single replica.
@kolere23 5 ай бұрын
I just built this in my homelab! Ended up with 3 master + 2 agent nodes on HP 705 G3 machines i got for super cheap.
@JaikrishnaAdithya 10 ай бұрын
Felt a long time since I watched your channel 😅 Great video Colton!!
@HardwareHaven 10 ай бұрын
Yeah sorry haha. That one took a while
@leadlearner6391 10 ай бұрын
another awesome video Hh 🎉 thanks. Can you please do a video on Notion 🙏🏽 and how you use it for productivity flow
@HardwareHaven 10 ай бұрын
Thanks! Probably not unfortunately, at least not on the channel. Maybe that could be a patreon/member only idea or something. It’s just hard making off topic videos
@Mauzy0x00 10 ай бұрын
Love that intro. Came from another video; subscribed ✔️
@TheSlyMouse 10 ай бұрын
First early access video :) love the content
@HardwareHaven 10 ай бұрын
Nice! And thanks!
@thejonte 10 ай бұрын
You got Notion to sponsor you! Congrats dude!
@HardwareHaven 10 ай бұрын
Thanks! 😁
@SB-qm5wg 10 ай бұрын
Pretty cool you ordered "parts" and got working PCs. 👍
@HardwareHaven 10 ай бұрын
Haha with a bit of work but yeah
@umikaliprivate 10 ай бұрын
it would be cool if you made a proxmox cluster on these, and combine their resources, to run one VM
@govindsharma7738 5 ай бұрын
is that possible? splitting a programs execution over 2 sets of hardware, how would a program run over 2 CPUs? I have one of those lenovo M910q looking to get another for my proxmox running homelab.
@runsec 5 ай бұрын
do you know if its also possible to do the same but with docker installed on the pcs ? so the container has linux
@gilatiq 10 ай бұрын
great viedo even though it is not a tutorial it is fun to watch
@DumReviewGRC 10 ай бұрын
It's hilarious to see you walking through Techno Tim videos when you look like Techno Tim yourself and doing kinda same stuff on the channel 😄
@HardwareHaven 10 ай бұрын
I just need more RGB!!!
@ha231 10 ай бұрын
New subscriber, your channel is awesome please don't be so hard on yourself!
@HardwareHaven 10 ай бұрын
Thanks! And I feel like I have a fairly healthy balance of confidence and self criticism haha
@crc-error-7968 5 ай бұрын
Hello, could these pc run jellyfin in docker? I mean with gpu pass and hw encode/decode? or better a solution with the i5 8th?
@Coentjeeee 10 ай бұрын
Great video!🎉
@HardwareHaven 10 ай бұрын
Glad you liked it!
@Denchozzz_ Ай бұрын
Hello, I've just made a corosync and pacemaker cluster between two debian 12 machines and I want to install CasaOS on the cluster so the load is balanced between the machines. Is it possible to install CasaOS on the cluster and if it is, how?
@johnmichaels4330 10 ай бұрын
I found out about notion last week. It's already changing my life. You should do a video on how you use it and ideas for others.
@johnsondu1896 4 ай бұрын
Any interest in using n100 mini pc to run this cluster? Which I think is a good idea too, newer and lighter, draws much less power.
@laobiz3523 10 ай бұрын
Many Nodes R/W can become a problem if the node is not completely down, but still running and just the network is disconnected. Then MC on the disconnected Node could still write into the volume, but also another MC pod would try to write there and in the end you would have data corruption. That's one of the bigger problems with Kubernetes and HA with persistent services :)
@HardwareHaven 10 ай бұрын
Oh yeah that makes sense. I really want to get a permanent k8s setup to mess around with and learn more haha
@lacuevadelinsecto 4 ай бұрын
I've been using a computer like those as mi personal local server, and I can say that those devices are immortal, and consumes very little power compared to the most of PCs. Thanks for the video!
@suraj_2123 5 ай бұрын
can you provide the process of programming the bios on the PCs since i have one sitting at my home with same problem
@DoubtingThomas333 10 ай бұрын
I did this several years ago with a pile of free thinclients. Twas quite hilarious 😂
@Techieeeeee 10 ай бұрын
Your content is so awesome!! Keep it up!! Don't forget us when you get even more famous!!
@HardwareHaven 10 ай бұрын
Thanks! And no way haha
@tomasnorre 7 ай бұрын
Have you ever experienced that the Thinkcentre shutdowns/reboot when removing the monitor? I have a M630e which does this regardless of using HDMI or Displayport. And it doesn't boot backup before adding the monitor again. Kind a defeat the purpose of a server :)
@sourcilavise3788 5 ай бұрын
Well, I'm currently training for the RHCE and the whole thing is about ansible. This could be an application for my elitedesk minis once I pass the exam.
@1986Redfield 10 ай бұрын
Awesome 👌 Sence you know inside and out of these 715q's, can you tell me how to connect external power button? 😊thx 😊
@HardwareHaven 10 ай бұрын
Other than soldering to the PCB, I'm not really sure
@1986Redfield 10 ай бұрын
@HardwareHaven the opposite side of the power button, there are a lot of pins. What are they?
@ijac 10 ай бұрын
This is all over my head but I enjoy the video and maybe I can learn something thanks.
@markwhitfield5412 5 ай бұрын
didn't understand a single keystroke, but well worth A LIKE.
@thejonte 10 ай бұрын
Hey, I'd like to do a K3S HA cluster between different NATs (mine and my grandparent's house), since the most risky part is the internet connection. I'm considering using Tailscale for the communication between the nodes and then have 1 node run my app at all times, and when that starts it tells cloudflare to set the A record to my current IP. Is this a good or flawed plan?
@codys1108 10 ай бұрын
Let me know if you get something like this going.
@samasrujan 10 ай бұрын
need a workflow for k8s on baremetal and with out longhorn.
@davidgates1887 26 күн бұрын
Hi, what about benchmarking all your CPUs and do a load test on them so they all receive the same load so you can use all the CPU at one time
@mattbrown8026 Ай бұрын
Watched :45 seconds. Best intro ever. Not kidding. Here is my LIKE! :D
@mattbrown8026 Ай бұрын
Bookmarking to watch the rest soon.
@FadeLight-ud2sl 10 ай бұрын
🔥
@huy1992fly 10 ай бұрын
I am quite impressed with your intro
@CaptZenPetabyte 10 ай бұрын
Great tute for Kewbs, shame these pcs here in Australia (even broken) are around $120 each
@dim3nt0 10 ай бұрын
what do you use it at home for?
@markclarke4895 5 ай бұрын
I've done the same thing with 3 HP Elite Desk mini pc. However, I created a Proxmox HA cluster then I created 6 VM's for k3s. 3 master nodes, and 3 worker nodes.
@cryptolobo2273 14 күн бұрын
Did you put all 6 VMs on one node? Or did you split master and worker onto different nodes?
@markclarke4895 14 күн бұрын
@@cryptolobo2273 I split them into different nodes.
@uroy8665 10 ай бұрын
how to configure connection between pc's ?
@Techdox 10 ай бұрын
Docker Swarm is also a great option as K8s can be very overkill for a home lab
@HardwareHaven 10 ай бұрын
Might be worth a video!
@atlas2858 10 ай бұрын
@@HardwareHaven please yes!
@hugosxm 9 ай бұрын
Hashicorp nomad too :)
@guy_autordie 10 ай бұрын
Jeff geerling make his ansible book free. He did a video about it with the link.
@win7best Ай бұрын
If you really wanted to setup a high avelebility minecraft server you would use something like multipaper with multiple waterfall proxies with a load balancer plugin and redisbungee and a redis cluster.
@kaneserver 10 ай бұрын
Best intro ever 😂😂 trust future me!
@geoshapka 10 ай бұрын
why didn`t you use statefullset instead of manually creating pvcs and attaching it to pods ? anyway good video :)
@HardwareHaven 10 ай бұрын
Because I still have a lot to learn about kubernetes haha
@geoshapka 10 ай бұрын
@@HardwareHaven Welcome to a world of confusing stuff, multiple ways to achieve goals and new problems you didn`t know you had ;)
@cwantuch 6 ай бұрын
Thanks!
@HardwareHaven 6 ай бұрын
No, thank you!
@dazealex 10 ай бұрын
Can you share which speakers you have on your desk?
@HardwareHaven 10 ай бұрын
Presonus Sceptre S6
@ChadDrakeTech 10 ай бұрын
This whole time I thought you and technoTim were the same person lol
@HardwareHaven 10 ай бұрын
Have you ever seen us in the same room?
@ChadDrakeTech 10 ай бұрын
@@HardwareHaven All kidding aside, you guys do look ridiculously similar. Or maybe its just me.
@lillianivie4556 10 ай бұрын
Its a crime what you don't have more subscribers
@IHateCS 10 ай бұрын
I wish there was a tutorial for rock cluster
@HardwareHaven 10 ай бұрын
Seems way above my level, but worth looking into!
@DoubtingThomas333 10 ай бұрын
It disappeared from Distrowatch. Very strange.
@LampJustin 10 ай бұрын
just wanna say that rook is probably not the best choice for most use cases. It's pretty slow and pretty dang bad on 1GiB/s. I'd much rather use drbd with the piraeus operator that does reads locally. So you'll get full NVMe speeds on reads and really fast writes thanks to drbd9. It's also very fault tolerant and survives a node drain unlike Longhorn...
@brandieboy 10 ай бұрын
Hi! I'm a new youtube member! I'm always happy when you put out a new video. So the least I could do is the membership on KZfaq.
@HardwareHaven 10 ай бұрын
Welcome aboard! And thanks!!
@shoukomi-sama 10 ай бұрын
Great guide though why use Debian instead of Alpine? Anyways, looking forward to your next video!
@HardwareHaven 10 ай бұрын
Just because I'm familiar with it and wanted to limit the number of things that I could mess up lol
@noth606 Ай бұрын
Every time you say "mc" my mind adds "hammer" and I have to suppress a chuckle to not start seeming even more nuts to myself. Hammertime! diidiidiidi-didi-didi.
@TECHiHOBBYIST 10 ай бұрын
Jeff have opensource his ansible for devops just saying It is great resource.
@TECHiHOBBYIST 10 ай бұрын
What a nice day watching watching Haven video on morning
@AviDarks 10 ай бұрын
Hey, I get an error: Task [K3s/POST: Apply Metallb CRS] *** FAILED - Retrying: [192.168.1.45]: Apply Metallb CRS (5 Retris Left). what could be the problem?
@HardwareHaven 10 ай бұрын
This might help: github.com/techno-tim/k3s-ansible/discussions/247
@sweetmelon3365 10 ай бұрын
Awesome
@personwhowatchesstuff8566 10 ай бұрын
cool video
@BarcioCC 10 ай бұрын
new video LET'S GOOOOOOOOOOOOO
@ar.piyushkhadke6342 9 ай бұрын
sir can use 3 pcs performance in one
@ppaliwal89 10 ай бұрын
what's the power consumption on these?
@HardwareHaven 10 ай бұрын
22:15. There are timestamps on all my videos to try and make finding stuff easier just FYI. Hope it helps in the future!
@kraio-sfu 9 ай бұрын
Pretty sure my doctor prescribed me lenovonode the other day
@Mawyman2316 10 ай бұрын
Id be careful with notion. Its freeware with a subscription additive, aka the most frequent business strategy to die and their stuff is not in plaintext so if they go down one day youre losing your brain maps and organization systems. There are opensource alternatives.
@muhammadnourmanhadi 10 ай бұрын
I try install rancher but error pulling image, any solution?
@HardwareHaven 10 ай бұрын
Error message?
@muhammadnourmanhadi 10 ай бұрын
@@HardwareHaven invalid-token-authorization-failed
@HardwareHaven 10 ай бұрын
Is there anything other than that?
@muhammadnourmanhadi 10 ай бұрын
@@HardwareHaven failed to copy: httpReadSeeker: failed open: server message: invalid_token: authorization failed
@MarcoGPUtuber 10 ай бұрын
The Hardware Haven drought is over!
@Sphyxx 8 ай бұрын
I looked at the thumbnail i thought it was a comparison
@ArifKamaruzaman 10 ай бұрын
I also want to learn Kubernetes.
@east4ming 4 ай бұрын
I'm an expert on Kubernetes, so if you have any questions, just ask me. Also, trust me, 90% of home labs don't need Kubernetes, docker/docker compose/portainer/nomad are sufficient.
@KonuralpBalcik 10 ай бұрын
Systems such as kubernetes and docker are already destroying processor performance, if you want a real cluster, you should use mosix or openmosix
@LandonHalley 10 ай бұрын
NEW HARDWARE HAVEN VIDEO 😎😎😎
@jefersoncirilo7177 10 ай бұрын
I remeber NileRed when I look to this guy
@HardwareHaven 10 ай бұрын
I get that a lot.. haha
@MrEndzo 10 ай бұрын
Aktually it's pronunced
@PreDaToReLeaSeD 9 ай бұрын
My naming scheme is LENODO lol
@HardwareHaven 9 ай бұрын
Beautiful. 😂
@shephusted2714 10 ай бұрын
you want regular desktop cases in terms of refurbs - more expand-ability and ease of use - refurb pc are value kings - no question - having a reg sized case will aloow you to add better networking and gpu options and stay away largely from vendor proprietary parts - you might use a bit more power - that is totally ok since you will probably have more better cpu and ram - biz wants cluster tech for HA but also since they can scale out easily - just add a node or two
@HardwareHaven 10 ай бұрын
No I don’t. At least not always. You might though! 👍🏻
@shephusted2714 10 ай бұрын
@@HardwareHaven I am talking to users and smb sector here not you specifically - they don't want compact and micro pc generally for reasons
@clubelementalsmp 10 ай бұрын
@@shephusted2714 Then why not specify that in your original comment? I see it says edited, not exactly sure for what though, wasn't to correct the "aloow" instead of allow. So what was the edit? And why couldn't you clarify in the original or add it during the edit?
@HardwareHaven 10 ай бұрын
Doesn’t look like the main points changed at all, so I wouldn’t get too upset.
@HardwareHaven 10 ай бұрын
I get it, but you’re still making assumptions. You’re assuming that people prefer expandability and performance over size and efficiency. In this instance, I 100% prefer the 1L cases over something larger and I don’t really care for >1Gbps since I’m not transferring a ton of data. So buying bulkier machines would’ve made no sense. And I don’t think I’m a unicorn. I think you could easily have said, “I would prefer and probably get larger form factors for the expandability and higher clocked CPUs” and been 100% correct. Just stop making blanket statements based on your opinion/needs/use case.
@Kzxhy 10 ай бұрын
5:25 oooo look how bent that ssd is, yikes
@dcfuksurmom 10 ай бұрын
i think the camera angle or lighting makes it look worse than it is
@HardwareHaven 10 ай бұрын
Yeah definitely looks a bit worse than it actually is
@dcfuksurmom 10 ай бұрын
@@HardwareHaven cameras have a habit of doing that. They also like to make a little bit of dust look like 20 lbs of dirt.
@sXeRalph 10 ай бұрын
It's pronounced kubernetes
@HardwareHaven 10 ай бұрын
Dang it!
@fteoOpty64 9 ай бұрын
You really cannot build any cluster with BROKEN hardware. Previously broken but fixed and upgraded...So it takes 5 months to do this...more realistic.
@whatthefunction9140 10 ай бұрын
What a monstrosity of services. Uuuk
@hand-eye4517 3 ай бұрын
so no github link??? im out!
@lucabarbolovici4974 10 ай бұрын
Dudee i'd like more hardware heaven ... Not softwareheaven 😢
@HardwareHaven 10 ай бұрын
Got a lot more used PC stuff coming up soon!
@lucabarbolovici4974 10 ай бұрын
@@HardwareHaveni rly hope 😭
@FritzCopyCat 10 ай бұрын
I like your content but the constant upspeak mid-sentence is really grating. You do seem to do it less when speaking off the cuff, so here's hoping you grow out of it.
RIHAN ARMY YT
Рет қаралды 10 МЛН