HOMELAB: A quick UPDATED look at my homelab...

[@Aerospace911]

pushing the definition of "homelab"

[@pism0549]

really a home datacenter

[@fabricekabongo]

Funny how he always gets this feedback, here and on Reddit.

[@TheSuitedEngineer]

I mean, it meets the technical definition. It's a "Lab" that's in his "Home" 🤷‍♂️😂

[@iCortex1]

Hey, as long as it fits in your house it's a homelab 🤣

[@CampRusso]

I concur. The day he has to build a “shed” in the backyard to accommodate everything. He’s graduated to a mini datacenter. 😉🤣

[@sith6375]

flexing on us in the intro with that beautiful living room AND the beautiful homelab too

[@keshav2136]

😂

[@bmoulas]

"homelab"

[@weholmes5315]

Just a few little “upgrades” 😂 I love it! Thanks Jeff for anchoring the upper high end of the home lab spectrum. Now back to the other Jeff for my regular home lab inspiration 😅

[@1creeperbomb]

The pocket datacenter man is back

[@KyleYoung101]

I rarely comment on videos, but this setup is a dream. The amount of pre-planning, the foresight in design and flexibility for the future, its aspiring. I would love a writeup, perhaps on your blog, of what career path took you this direction, and any resources or great books on datacenter infrastructure and design.

[@pangloss3619]

As a SRE who works too much because it doesn’t feel like work (still can’t believe someone will pay me to do something I’d do for free) - this is the dream. I’m envious of the opportunity to test and play on all these things - you must have learned so much! Enjoy, what a time in life.

[@cidadaoPPT]

honey, wake up. Jeff released a video!

[@jeffsponaugle6339]

Ha! I have 5 in the edit queue.. I need to hire an editor!

[@maxmustermann194]

​@@jeffsponaugle6339Was starting getting worried this channel not posted for quite a while :D Need inspiration for my little lab. I do edit tech videos among others btw if you are actually interested.

[@mexisnake]

@@jeffsponaugle6339 Hello, I'd like to throw my hat in the ring for editor as well. I worked for a nightclub filming and editing their weekly vlog for a bit, couldn't keep doing it because it ruined my sleep schedule and didn't let me rest on weekends. I live in Lake O and work as a Project Manager in Tigard, I earn a fixed salary but have been considering a part-time job or freelancing to fix my car more quickly and loosen the reins on my budgeting. I can send examples of my work and would meet in person if you'd like. I can edit a video of yours and if you like the result you can pay me what you think is fair, if I agree that it's fair we can move forward. Thanks for your consideration!

[@tomerhorowitz4779]

@@jeffsponaugle6339 Honey is not getting any sleep any time soon

[@CampRusso]

🤣🤣🤣 I wish. This would put my wife to sleep in 17sec!

[@angryox3102]

31 kW? That electric bill must be crazy each month 🫨

[@davidanthonyhenderso]

I was curious about that. Not to pry, Jeff, but what's the monthly nut to run your homelab?

[@bebop_10]

I can't get enough this homelab, or should I say a home datacenter lol! Great video as always!

[@UpperJeuno]

I can't get enough of these videos Jeff! Fantastic stuff sir! Happy Holidays and keep geeking out! :)

[@HyenaEmpyema]

even if I could stay home all day I couldn't manage a lab this big. Bravo.

[@johnny4848]

Just discovered your channel, huge respect from Greece. I hope I come to US one day

[@exec.producer2566]

Bro is absolutely terrified of becoming vendor locked on AWS 💀

[@jeffsponaugle6339]

Ha!

[@dayisepi547]

dud your home and all your lab are my dream

[@kshitijjande8512]

How lovely and cool this is! It's my dream to build something similar one day.

[@Saintel]

At this point can you even call this a HomeLab? This next level 🤯

[@RaidOwl]

lol jesus christ...

[@JasonsLabVideos]

Awesome video, that looks like a fun project adding 100g nic cards !

[@jeffsponaugle6339]

Yea, that will be the most work, since sometimes getting those into the card slots means sliding the servers out the front, which of course means disconnecting everything!

[@jamess.2491]

So happy I found your channel; there’s almost no examples on KZbin for people who have extensive setups like yours. Would be interested to see what your home automation looks like. Mine has gotten so massive it takes up almost a full rack, with a few distributed processors around the house.

[@cjceeez9897]

those cto direct deposits are the backbone of this operation.

[@jefferyosei101]

I’m so so inspired ❤, wow very very beautiful!

[@Jordan-hz1wr]

You know what I love more than these Lamborghini’s? Knowledge

[@steelelogan8751]

Love this stuff man... Your ISP must hate you though for the data usage lol! Keep up the great stuff

[@jtfxjhggvkuhhvktgu]

If this isnt motivation idk what is This is amazing man

[@witness1013]

I'm a plumber. I have a homelab - it's my toilet.

[@jeffsponaugle6339]

This is comedy gold.

[@bentheguru4986]

Hey Jeff, the best mod you can do with those APC's UPS's, mod them and get rid of those batteries that die all the time. Changing to much bigger AGM/SLA's stops them being an expensive waste.

[@jeffsponaugle6339]

Yea, that would be a good idea. I have to look into that. Any links oresuggestions appreciated!

[@bentheguru4986]

@@jeffsponaugle6339 Let me know what model you got, battery config governs way to go about it.

[@SwiatLinuksa]

It's good to have high ceilings ;)) Beautiful Christmas tree, house too and the server room is amazing ;))

[@johnvillalovos]

I was glad to hear that was a high power usage moment! Portland General Electric charges me around $0.175/kWH and at the consumption shown it would almost cost $4,000 in electricity! I actually added cost to my Grafana dashboard to show daily, weekly, monthly, and yearly costs for what I am tracking. Sounds like you are happy with the IoTaWatt. Every time I check they are sold out 😔

[@jeffsponaugle6339]

Yea, PGE can be expensive, but the solar helps out a lot, and I have a seperate time of use circuit for the car charging, so that is cheaper at night. The IOTAWatts work great, but yea they seem to be hard to get now!

[@johnvillalovos]

@jeffsponaugle6339 thanks. I'll keep trying to get one. Until then I'll keep using my Shelly Plugs for my computers.

[@KastanDay]

just my spare 8x48 port switches hahaha. Makes sense after seeing the 100G switches.

[@prashanthb6521]

wow, very nice setup.

[@GregDePasse]

I'd love to learn more about your economizer setup if you could share. I have a similar setup but with much less stuff. I'd love to figure out how to dump heat into my garage and use outdoor cool air here in New England.

[@br3nd4n]

Stop the presses! He’s back!!

[@k3nny6969]

the king

[@Ashton-em8dl]

This "Home Lab" is better than my work hahah

[@shalinpather4198]

Hi Jeff. I really liked your homelab and subscribed to you since the first homelab video. I'm starting small, building a cluster at home with only two old 1L PCs (4th-gen Lenovo ThinkCentres) with the goal of building up my skills and homelab (as funds allow) to get to something much bigger (maybe even what you're doing). I'm a little stuck on the software software - which industrial-scale software do you use to coordinate your cluster and run apps on it? k8s? OpenStack? Please give us a guide/tour on the software side of your homelab soon. Thanks.

[@Obsidianxenon]

The bar above the central networking node is giving datacentre vibes. Can you do a video on how you manage the servers software-wise?

[@boredfilms578]

This is my dream man... hopefully someday.

[@neilbradley]

I did a network upgrade to 100Gb for my backbone,and my biggest surprise is my dual Epyc 7742 can't push more than about 8 gigabits with a single core. That was a surprise!

[@jeffsponaugle6339]

Yea, if you use something like iperf3, you have to use a lot of cores to push 100gbit! I have some older Mellanox cards that are PCIE 3.0 8X, and the PCIE bus at that config can only do about 60gbit so it is not possible to max out those cards regardless of the CPU!

[@neilbradley]

@@jeffsponaugle6339 Yep, iperf3 was my benchmark. I'm using the old Intel 540X-T2 converged adapters, so they're PCIE 2.0 16X (but dual port, so maybe also 8X each). Maybe I'd get a bit of a boost if I went with a Mellanox card or something newer....

[@neilbradley]

@@jeffsponaugle6339 Also, no AI server? That's perfect for an NVL72 or upcoming NVL2/4 setup!

[@jeffsponaugle6339]

@@neilbradley Yea, I have some newer Mellanox cards that do 8x PCIE 4.0, and that can actually push 100g if you have enough CPU side... usually something like 16 threads in iPerf. Did you swtich to MTU9000, as that can certainly make a difference for a single core.

[@jeffsponaugle6339]

@@neilbradley Need one!

[@huskyman20435]

Jeff, with a setup like this, doyou offsite backup to the cloud or your own remote vps?

[@matiastillerias7721]

My dear Raspberry Pi 1 and I enjoying this video 😢🤖

[@jeffsponaugle6339]

A raspberry pi is what is driving that LED matrix, so it says hi.

[@DanielTekmyster]

Would love a video on how you are running non-cisco os on the old ASAs!

[@jeffsponaugle6339]

OK - I can do that!

[@Flankymanga]

Nice labels on the walls. I wonder is there some software that would help me design the physical layout of a homelab and also from networking / powering perspective what is connected to what?

[@militaryforcestv1]

is this what you call a 'NERD CAVE'. Amazing stuff!

[@aniketsharma7333]

Please give us a complete tour of your homelab, There are many things to learn from it :)

[@jackthibo7644]

Hey Jeff! Thank You for these GR8 videos! Could You perhaps do a video about comparison between Hikvision and Unifi Cams? Also perhaps about if you use NX witness as a VMS

[@brunodelpiero]

You made my dream come true

[@tycoonier]

I saw that there are heat pump models on the market now that can extract heat from a room over a target temperature, and put it into other rooms that are calling for heat. While it's probably not something that would work for you, as I expect it would require a refit, do you think it would work well for server room cooling? As you're effectively running multi-Kw space heaters in that room and all that energy is being vented to atmo right now.

[@jeffsponaugle6339]

Yes, and I do that partially right now - When it is cold outside I bring in fresh air from outside and push hot air into my upper garage. I could use a heat pump to do that, but it would probably not be as efficient in net power, and or course in the summer that mechanism doesn't work at all. If I were building new however I do think a multi stage heat pump would be a good way to make better use of the servers aka heaters!

[@tycoonier]

@@jeffsponaugle6339 Fair enough! I've always thought it would be a nice use for a homelab, as it's pumping out heat anyway, so in the winter it heats the rest of the house and in the summer the heat pump just acts as air conditioning, which you were going to be running anyway.

[@Therockkdude]

I'd love to see a video that describes the network and services architecture setup for larger systems like this.

[@SyberPrepper]

Such a wonderful setup. I could make a positive comment about all the different parts of your lab, but many here have done that. I'm preparing to setup about 12 workstations at work and would like your recommendation on KVM. What are you using and would you choose something different now? Thanks.

[@jfred1989]

Very impressive setup. What is the business model that allows you to purchase and maintain this lab? Is it just a passion project and used for learning? Thanks for the video.

[@simonlenhard1712]

I wish I had such a view in my living room too

[@guennorin2101]

Good hobbyist ! Curious what you do with it ??

[@anwar.shamim]

ITS hUGE - My Dream build like this

[@stvka]

how do you backup something this large? do you mail off the drives or something or just not backup at all and rely on raid?

[@jeffsponaugle6339]

I have a partial cab in a real datacenter, and I do network backups to that location - Plus my storage itself is split into primary and backups - And I backup to LTO tape and store those offsite.

[@stvka]

@@jeffsponaugle6339 wow

[@macdememe]

Hello, Jeff, thank you for video! I have a few questions: 1. How did you seal the doors so that they don't let noise through? 2. Will there be a tour of the whole house, as well as all car projects? 3. Do you have servers for 2011-3 or do you have newer sockets?

[@jeffsponaugle6339]

It is a solid door, outside rated, with a drop door seal... and the door frame is double insulated and sealed for noise blocking.

[@Rx7man]

I'd like to see you and Dave Plummer have a sit down and chit chat! You seem to be cut from the same cloth!

[@arnivska]

The Bloom filter display on the the right, look´s a bit like the lights on the W.O.P.R just need to make some of the sections yellow and perhaps try to find ominous droning sound it made to complete the effect :)

[@jeffsponaugle6339]

Ha! Yes did you notice the picture on the wall near the back of the racks?

[@arnivska]

Hahah no had not spotted that had to rewatch and pause at 5:24, very fitting indeed :)

[@richardcurteis5816]

Buddy finds time to do his job and his home lab. I can't find time to do either.

[@TheChunkMonk69420]

"homelab" more like "home Data-Center"

[@alexrosenberg_tube]

I strongly prefer the software in the Raritan PX3 PDU series over APC. I only wish Raritan would make UPSes with software that good. Somebody's gotta disrupt the UPS market with good software soon.

[@jeffsponaugle6339]

Yea, the APC software is terrible, and the UPS cooks batteries! On the next refresh cycle for the batteries I am going to look at changing ..but I too wish there was some disruption in the UPS market!

[@m1dnightcrisis]

I would like to know what this nice looking setup is used for. To me this seem overkill for everything i could imagine. Please Enlighten me so i can have one less thing to worry about instead of sleeping. Thank you :)

[@ClayunderSeal]

What i find funny are these random boxes everywere XD

[@jeffsponaugle6339]

So much cardboard!

[@wesleycaldwell]

This is all very cool. But nothing mentioned seemed to justify all of this. I build stuff that is completely overkill just to play all the time, so i get it. But is this for a purpose or just playing?

[@johnharrison712]

How did you acquire your Nimble storage arrays, and how are you utilizing them? Are you running the Nimble OS on these arrays without an active support contract?

[@jeffsponaugle6339]

I hacked the Nimbles - They are running a direct Debian distro now. I'll do a video about them.

[@bioboi4438]

This is my vision!

[@mikaackermann4072]

Do you have an overview of all the equipment in this video?

[@Jelly-Josh]

nice homelab

[@ralmslb]

2.40 31kW??? Holy shit!

[@alfredoboys]

Can you please do a video on home ddos protection

[@montiesmith8331]

I get so excited about setting up the hardware and infrastructure for my homelab, and by the end I don't really have enough projects to actually justify the scale of my lab...

[@jeffsponaugle6339]

Yea, it does help to have some good projects you can actually use the lab for. Of course learning about new technology is good, but it is fun to have something more specific. You could always do some protein folding!

[@FedericoPagliai]

what do you need all this for? what do you do with it?

[@tcdontplay4914]

love it

[@lzgmc]

Nice datacenter

[@n.lu.x]

How are you able to draw 31kW (even if it's not entirely from the grid)? In the EU, residential installations wouldn't allow this

[@jeffsponaugle6339]

I have 600amps of electrical service and my own 50KvA transformer, so I could draw 100kw depending on the outside temp.

[@DavidM2002]

Honey, we can sell the furnace now...

[@JNik2000]

does anyone know who the manufacturer of these led panels above the rack is?

[@jeffsponaugle6339]

Those are generic 32x64 panels, and you can get them from Adafruit.

[@ti4go]

2nd channel link?

[@nellovx]

what do you think about supermicro AmpereOne A192-32X arm server

[@jeffsponaugle6339]

I saw that Jeff Gerling was reviewing one, and it looks really interesting. I'd like to play around with some ARM hardware!

[@bosch5303]

5:10 slightly overkill for an ntp server

[@jeffsponaugle6339]

Yea, on the otherhand they are nice boxes, have ECC memory, RAID disk, and dual power supplies, so good for DNS.

[@reapzzer]

At this point it's more of a LAB that has a home in it not the other way round hehe

[@DankHypatia]

You need an R840 with 12TB Optane.

[@jeffsponaugle6339]

Optane. Yum.

[@vbostrom]

No HDR video stream?

[@neilbradley]

That's like 500 of them. ;-)

[@clark05]

what are you using this for?

[@pedroset7972]

what do you do with all that, besides youtube videos??

[@livtown]

what is even running on all of this? i know hosting providers with less gear...

[@ronniesunshine1163]

I was going to make a dumb comment jokingly saying "only 10G connections, not even 100G?" and then I got dunked on at 6:06

[@AmbientShores]

You could sell some SaaS solution with such back-end. The question is "What".

[@Fordtruck4sale]

Unlimited budget, proper implementation, the real deal. Still adds RGB just to troll? lol

[@jeffsponaugle6339]

I just love RGB. ;)

[@3nth]

I am jealous dude haha

[@StevenGutierrez-sf7vn]

how much is your light bill

[@quickhash7303]

What do you possibly do to need that much infrastructure?

[@mattpears2472]

Can someone in a simple term tell me why he needs all of this equipment like I know it does cameras and some searching and stuff but like what is he using all this for could you make a list or something like home computers home cameras and what other stuff?

[@jonathanpisarczyk]

The only thing I would critique. Why on earth did you run a conduit from the temp/monitoring screen down the wall instead of fishing inside the wall. Otherwise unbelievable! 🤯

[@jeffsponaugle6339]

Ah yea, I thought that would be temporary! I do like having the display there so when I walk by I can see what is going on.

[@firstlast-vh8gz]

hyperscale homelab

[@steverude]

What's the onion url?

[@alessandrofermanelli2403]

my bro, you just built eden

[@rayjaymor8754]

If I won the lottery, I wouldn't tell anyone... but there would be signs...

[@easygamer6994]

bro is hosting google , that would be so hard my dream server room

[@DPCTechnology]

Homelab goals... LOL

[@nielstaildeman]

Weird to see all this enterprise gear matched with a UDMP as a firewall.

[@jeffsponaugle6339]

True, but there is a reason for that. I'll do a video on network interconnections soon - This is 99% internal use equipment. I do of course have a pair of PFSense firewalls, plus a pair of Palo Altos, but that is just to play with.