What Software is Running in my Home Lab???

Related Videos:
Home Lab Tour (hardware) - • Servers, backups, netw...
How I Backup Data - • How I Backup My Data f...
Unifi Setup - • Unifi Home Network Upg...
Omada Setup - • Home Network Upgrade -...
Omada Short Stack - • TP-Link Omada "Short S...
Reolink Setup - • Upgrading my security ...
Minecraft in Docker - • Minecraft Server in Do...
Dashboards Review - • Which Self-Hosted Dash...
American Cloud hosting - • Home Lab in the cloud?...
Nginx PM w/ Cloudflare - • Self Hosting on your H...
Kubernetes Learned in a Week - • 7 Days to LEARN KUBERN...
Hardware:
Networking:
My Unifi Affiliate Link - store.ui.com/us/en?a_aid=RaidOwl
UDM Pro - store.ui.com/us/en/pro/catego...
Enterprise 24 PoE - store.ui.com/us/en/pro/produc...
Enterprise XG - store.ui.com/us/en/pro/produc...
Enterprise 8 - store.ui.com/us/en/pro/produc...
Flex XG - store.ui.com/us/en/pro/produc...
Flex Mini - store.ui.com/us/en/pro/produc...
IW HD - amzn.to/46L7MmG
U6 Pro - store.ui.com/us/en/pro/catego...
U6 LR - store.ui.com/us/en/pro/catego...
Omada Controller - amzn.to/482jASv
Omada Firewall - amzn.to/47G8tiD
Omada AP - amzn.to/47ZD9Lj
PatchBox - link.rdwl.me/EY1yb
Blue Patch Cables - amzn.to/3Gpouxi
Servers:
Main
EPYC 7302 - amzn.to/3Gpzg6z
ASRock Rack ROMED8-2T - www.asrockrack.com/general/pr...
Noctua NH-U9 - amzn.to/47Dv0g1
Mellanox ConnectX-3 - amzn.to/3uA8c1S
LSI 9201 - amzn.to/3NcBbiW
Rosewill 4u Chassis - amzn.to/3R4bAtp
Rails for Rosewill - amzn.to/46I6w3T
HA Cluster
SuperMicro X10SDV-4C-TLN2F - www.ebay.com/itm/284496569609
Micron 7400 Pro - amzn.to/3uA8gPa
InWin IW RF100 - amzn.to/47CuHln
Main PC
13900k - amzn.to/47LmUlC
RTX 4090 - amzn.to/412dkIp
Gigabyte AORUS z790 - amzn.to/46G9dD1
Corsair Vengeance - amzn.to/47G7LBZ
SilverStone 5u Chassis - amzn.to/47BHYL2
Synology RS822+ - amzn.to/419Cgxx
Synology DS923+ - amzn.to/3R4HqX2
45Homelab HL15 - link.rdwl.me/SDsWw
Misc:
Mini Split AC - amzn.to/3RqFIAI
Mini PC - amzn.to/3uLJ2xC
TinyPilot KVM - link.rdwl.me/hIeTf
Navepoint 42 Rack - amzn.to/3GrzwCg
TrippLite 1500 UPS - amzn.to/3T4I3lZ
TrippLite KVM - amzn.to/3T8pT2N
Magnetic Monitor Mount - amzn.to/3sRG4XL
Rackstuds - amzn.to/3RqvfnR
-------------------------------------------------------------------------------------------
🛒 Amazon Shop - www.amazon.com/shop/raidowl
👕 Merch - www.raidowlstore.com
🔥 Check out today's best deals from Newegg: howl.me/cjNc3sze2O3
-------------------------------------------------------------------------------------------
Join the Discord: / discord
Become a Channel Member!
/ @raidowl
Support the channel on:
Patreon - / raidowl
Discord - bit.ly/3J53xYs
Paypal - bit.ly/3Fcrs5V
My Hardware:
Intel 13900k - amzn.to/3Z6CGSY
Samsung 980 2TB - amzn.to/3myEa85
Logitech G513 - amzn.to/3sPS6yv
Logitech G703 - shop-links.co/cgVV8GQizYq
WD Ultrastar 12TB - amzn.to/3EvOPXc
My Studio Equipment:
Sony FX3 - shop-links.co/cgVV8HHF3mX / amzn.to/3qq4Jxl
Sony 24mm 1.4 GM -
Tascam DR-40x Audio Recorder - shop-links.co/cgVV8G3Xt0e
Rode NTG4+ Mic - amzn.to/3JuElLs
Atmos NinjaV - amzn.to/3Hi0ue1
Godox SL150 Light - amzn.to/3Es0Qg3
links.hostowl.net/
0:00 Intro
0:31 Networking
5:50 My main Server - Proxmox
6:15 TrueNAS
8:33 Docker
10:27 LocalAI
11:32 Plex
12:03 Random stuff on main server
12:25 HA Proxmox Cluster
13:36 Kubernetes cluster
14:41 HA Docker
15:09 arr stack
15:25 Shlink
15:55 pihole
16:13 Nginx Proxy Manager
16:40 Homarr dashboard
17:33 Owncast
18:39 Synology Setups
20:24 MISC stuff
23:17 Conclusion

[@LevantinLynx]

Thank you for not only showing us in great detail what you are using and hosting in your lab, but also the reason behind it. 👌

[@Mike-tz9le]

I would like to see an entire network walk-through. Great stuff though Brett!

[@RaidOwl]

Coming soon Mike! Thanks so much!

[@Kirmo13]

YT yoinks 30% of that donation

[@marlo-ji]

@@Kirmo13 C'mon, they're spending billions to keep YT servers up, let em have it

[@Kirmo13]

@@marlo-ji well from the moment Alphabet makes well into the double digit billion dollars in profit every quarter, I think that taking a 30% cut off DONATIONS without a clear warning is not a something cool. and btw, it's 30% after conversion rate and taxes ofc

[@RaidOwl]

@@Kirmo13 YT provides an amazing platform for people to create and spread knowledge for free as well

[@DanceingDragon]

Call me crazy but I think one of the best things on his setup is that he has two (2) ISP's I would LOVE that!

[@SteveStowell]

You can have it

[@hotrodhunk7389]

Yes if I work from home I am absolutely getting starlink and aggregating both into one super Internet!

[@SpoonHurler]

I can only get one fiber (cause god bless monopolies) and something else like 5g (gag) or satellite (less gag when it's not summer). I have considered it but I still don't have my lab built yet 😂

[@BenReese]

5G is fantastic for backup! That's what I'm using as my main ISP until Fiber is here in a few months, and it's what a lot of businesses use. Compared to DSL speeds, DOCSIS cost/speed/reliability, and StarLink cost; it's pretty great!

[@jig1056]

This is incredible, I love your videos. I'm redoing my home lab and smart home setup, I've definitely picked up a few nuggets on how I may end up segmenting my network. Thanks for the awesome content

[@GSM2C]

You, TechnoTim, STH guy and hardware haven should have a bbq vlog. Keep up the awesome content and making me feel inept!

[@MasonzeroDigitalWorks]

I had a good time watching the hardware overview video. This one went over my head a little bit. But it kind of kicked my butt into gear to finally make my first VM in the NAS that I've been running so that I can run Docker and then run Pi-hole. I'm hoping that will be a gateway to more advanced things, but I figure that's a good place to start given how practical it is. I've been intimidated by all that you can do in a NAS and have stayed with only a very basic backup storage setup. And yeah a network walkthrough would be pretty cool too.

[@YetAnotherSysAdmin]

Awesome homelab! This gave me a couple new ideas to try out. Besides: One can never have enough gear/services/hardware!

[@nigelnovelo279]

We need to see that network walkthrough bro! Amazing content btw.

[@MaxVoltageMiningCrypto]

I have a baby home lab and now know what I am missing in my life. lol Thanks for sharing. It has gotten the juices flowing on what project to work on after I build a server for proxmox and truenas.

[@LordLlamaLuck]

Yeah please do the full network walkthrough. I am doing many of the same things, and have a relatively similar setup to you (UDM Pro, Proxmox, TrueNAS, etc...) but I feel like I might be missing some key points that you would probably cover. Especially with firewall rules, inter v-lan routing, how to allow internal & external connections to only specific devices appropriately, how to properly match IPSec, VPN setups, etc.... and if you are able to do this, maybe cover Proxmox VLAN/Firewall rules for stuff? I am 99% sure I have things configured correctly but I often second guess myself. Right now I have nothing exposed externally but I am almost at a point where I will start exposing 1-2 service's externally, so if you're able to cover this topic it would probably really help give me a confidence boost and better understanding. I am really big on security (e.g. isolating networks, devices, only using secure protocols [even on an internal vlan/network], geo-blocking, etc....) so any deep dive into this or networking tips in general for Unifi would be much appreciated!

[@godelrt]

Another breakfast video! Thank you!

[@alanjrobertson]

Really comprehensive round up and useful to have the diagrammatic representation too, thanks! Would definitely be interested in an entire network walk through. Out of interest what are you using image-wise to run your MacOS Proxmox VM?

[@TheInternalNet]

Really amazing setup. I want to know more about your node js. I am playing around with react as well. Thank you for the indepth rundown.

[@xdcrashdx5122]

Awesome videos, with good ideas. I would love to see a network deep-dive cause I’m running a similar setup and would want to know, how you manage the network in detail

[@ryanseleski21]

Great video Love your content

[@boneappletee6416]

Would definitely be interested in both a CEPH and/or networking deep-dive :)

[@intertan]

Got to get that Cloudflare thing setup

[@nadtz]

Nice setup. I might have to see what I can do with localai here, gotta finish rebuilding my proxmox server first but definitely one I'll add to the list.

[@RaidOwl]

I've had a blast with it so far

[@YAEteddy]

One day, I will understand all of the stuff you got going on in your Home Lab, lol. Subbed.

[@notmynameX]

yes full network walk through; I'm just learning about vlans

[@Gery-zg7ky]

thanks for the vid bro

[@JonnieF14]

Would love to see a full network setup/walkthrough about to take the plunge into a full Ubiquiti setup.

[@xellaz]

I use Wireguard via my Firewalla to connect back to my network securely. Firewalla makes managing my simple network easy. 😋 My next project will be running CasaOS on a Raspberry Pi 5 when I receive it. I do have more powerful mini-PCs to do this but I want to run everything as low power as possible. 😊

[@eyluismi168]

Awesome video. Something I am interested to know is the energy usage of that setup because when people are thinking about home setup, the electricity bill is a serious consideration.

[@RaidOwl]

Everything uses around 600W

[@rdsii64]

For home security I'm using blue iris on a used Dell R720. The only camera I have right now is a HIkvision PTZ. For only one camera its complete over kill. The goal over time is to add a lot more cameras as I can afford them. a Dell R720 is overkill for only running one service. The catch is it was cheaper than just getting a complete hikvision nvr. The rest of my homelab only consists of an Emby server and a rack mounted desktop computer so far. In the near future I will be adding a dedicated "sailing ship" (if you get my drift) that will be crewed by radarr, sonarr, and prowlarr. NordVpn will be the ships captain. It will dump the contents of each "port of call" onto m emby server on the fly.

[@ronm6585]

Thanks R.O.

[@skovgaard79]

Nice setup

[@RaidOwl]

Thanks!

[@bulzaiguard]

I also went to homarr from heimdall like me It's solid and it can show some detailed stuff that I didn't have with heimdall

[@ProfiN00b]

cool setup gave me a ton of ideas to try out thanks for the video

[@bopal93]

Great video! Interested in seeing how you setup cloudflare for the web traffic into the lab. I have been thinking to self host couple of websites and synology drive stuff for public sharing with friends but always been held up due to security concerns.

[@RaidOwl]

Check out my Cloudflare with Nginx video :)

[@florethebrave]

Man, I used to rock that exact same dark wood wallpaper for yeaaars. Way back when 4:3 was still the norm

[@mdd1963]

"...to store your anime...." I smile every damn time I hear it! :)

[@3hukwuma]

You should look at bypassing the AT&T gateway and replacing it with an sfp in your udm pro

[@RaoulHira]

Don't think it's possible with newer models which have a 5gb port

[@jwh253]

Great set of software! Might be another video, but what led you to using TrueNAS instead of Proxmox's built-in ZFS and doing SMB passthrough through something like a Cockpit LXC? (Been debating this in my own homelab.)

[@RaidOwl]

Proxmox is very much lacking in the UI portion of network storage. I like the features TrueNAS brings.

[@vickknox]

Love your setup and your videos. Just curious what's your day to day job? Or is it being a KZbinr?

[@RaidOwl]

Thanks! I work in application support and development. Basically building windows services and .net apps.

[@Pnutt0r]

Would love to see a networking deep-dive for sure!

[@bdhaliwal24]

Another inspirational video. Can you describe more about how you’re using local AI?

[@RaidOwl]

It’s mostly just for the Nextcloud Assistant and to get my feet wet with AI. Once I have a bit more experience with it I’ll def put out a video on it.

[@alienJIZ1990]

Solid setup. Although personally I'd go with AdGuard over Pi-Hole and while i haven't used OwnCast, i loathe RTMP from my experience with Frigate early on - there is nothing smoother than WebRTC, so best if it's based off that imo

[@monish05m]

@15:18 wink wink yaaarr, totally understand the time constraints.

[@mdd1963]

I'm impressed by those functional/colored block diagrams! Excellent! (How did you make those?)

[@RaidOwl]

Thanks! draw.io

[@mdd1963]

Arigato! @@RaidOwl

[@antonterekhov9389]

Hey, excellent video, but I'd recommend reviewing these VLANs. Putting cameras and other IoT devices into one VLAN isn't a great idea. Your personal footage is private information. Ideally it should be a dedicated VLAN without Internet access that can write footage to the NVR only (I'd recommend self-hosted BlueIris). Get rid of Reolink external access ASAP. External VLAN sounds interesting, but it has access to Main VLAN server, so it doesn't make a lot of sense in this VLAN. External VLAN may add security if it contains the web-server and proxy server, so these two are independent and have a very limited access to other VLANs by ports and IPs.

[@jimmyscott5144]

Pterodactyl is great. I run it on one pc dedicated to just that. I hate how when I set it up they didn't have good documentation on how to host both wings and panel (front end and backend) on one pc. I figured it out but it took a bit. Might be better now though.

[@jan-Juta]

Looks like you're missing ssl certificates for your a lot of internal systems, getting DNS-01 challenge ssl certificates is super easy without needing to open up your server to the Internet, definitely worth looking into.

[@RaidOwl]

Yeahhhhhhhh one day

[@gm4765]

Awesome video! Quick question for 12:15. You mention having a macOS VM. How does this function? I was under the impression that installing macOS on anything besides apple silicon is now pretty difficult.

[@RaidOwl]

It’s an older VM that I rarely use anymore. It runs fine tho for an older version of MacOS.

[@bas18872]

I would like to see an entire network walk-through!

[@viper-den]

Please do one of the them there network dives mate

[@user-lb8ny2cb9p]

Finally! Awesome video. And yes, make my dreams come true and show us a network walk through

[@zzglenm]

I’d love to see a video about traffic rules versus firewall rules in Unifi network.

[@alainmondesir8461]

I don't know about making dreams come true, but I would like to see a network walkthrough.

[@jamestiller]

Yeah, I'm thinking I would like to transition my homelab to something very very similar to yours, and some TechnoTim inspiration.

[@RaidOwl]

Gotta sprinkle some TT in there

[@jamestiller]

@@RaidOwl for real! .. now is just finding the time to make the largest part happen. Getting Plex onto it's own so I can work on virtualizing the rest. I think my entire fam uses it so there is almost zero time (when im awake) that multiple people arent viewing. 1 step at a time.

[@catdotpet9006]

When you said "Ubuntu desktop running plex", I asked "Why?" at the same time as you XD I am using an older laptop as a server, using Ubuntu server that runs a file sync with my laptop in case I have to leave home and still have access to files. When setting up, I just used the webUI to set up Plex. Also, I set up my file shares by editing the smb.conf file, but now have switched to using Cockpit. Runs great. Again, why ubuntu desktop ? XD

[@athletic_nerd]

Great video ❤ I’m exploring proxmox for the first time and was wondering how to share the storage pool/dataset from Truenas VM to other VMs and LXCs. Any suggestion please? 🙏🏻

[@athletic_nerd]

I thought to mount them back in proxmox as SMB share but didn’t know if it makes sense to mount storage back to proxmox which are essentially created from Truenas VM which is running on same proxmox. Kind of a deadly loop 😅

[@RaidOwl]

Yep that’s pretty standard 👍🏼

[@marklewus5468]

I really liked the graphics that you used to show your VLAN and Software layouts. Can you tell me what graphic software you used?

[@RaidOwl]

draw.io

[@rajivvishwa]

Can you talk more about openVPN and synology remote backup? I've 2 synology NAS and I'd trouble with quickconnect for ddns, hyperback and tailscale. I want to see if your setup is straightforward

[@RaidOwl]

I can answer questions in my discord. Also, my Backup Upgrade video may help you.

[@thebearjew8463]

what program did you use to map out your infrastructure? I need to get around doing that for mine. My homelab is getting a tad bit chaotic lol

[@RaidOwl]

Draw.io

[@blazedreality]

I have a dream to have a setup like this one day

[@epochphilosophy]

I think one thing that has always confused me a bit is how you integrate Ceph, alongwith Kubernetes in a hybrid Proxmox/K3S setup. Kubernetes storage is weird and finicky, and I am curious how you use Ceph at the Proxmox level to make it a bit easier. I know you covered a bit of it, but a more in-depth look at this and perhaps HA storage as a whole would be great.

[@RaidOwl]

I think the go to for Ceph integration is Rook. I’ve dabbled in it a bit but it was giving me trouble. Ima have to revisit it.

[@epochphilosophy]

@@RaidOwlAh gotcha. Yeah, I was having massive issues with longhorn when trying to create replicas. For many helm charts and/or apps, you cannot seem to use HA storage via Longhorn. I kind of came to the conclusion what is the point of using Kubernetes without true HA? That said, using TechnoTim's guide, Traefik and Cert-Manager seemed to work fine via replicas, it was only when trying to create apps with true HA (3 replicas and longhorn storage) was when I ran into problems. Figured you ran into the same issue and a hybrid Ceph setup was a potential solution.

[@mf1315]

Curious why you don’t run your ISPs in active / active mode if you’re already load balancing through CF?

[@RaidOwl]

Cuz I don't really need the extra bandwidth, idk lol

[@gosbusta]

Minor question - Is there a reason you didn't just select multiple networks under "Local Network" such as iOT / Other and block access to all devices instead of creating the same rule for different networks?

[@itznolimitz]

I'm a fan of running services on separate VMs as well, but I run plex in an lxc container simply because i need transcoding and passing through a gpu to a VM will not allow migration to work since you can't migrate a VM that has hardware pass-through. Lxc containers can be migrated provided the hardware is the same in the proxmox cluster. One downside to this is you can't do live lxc migrations, the container needs to essentially stop, migrate, then start. Better than having extended downtime when doing maintenance or a host fails or something.

[@RaidOwl]

Really good point

[@bigpod]

wow what a complex network setup, IDK but i personally dont host anything at home that would directly connect to public internet. also i dont do guest wifi cause i dont give guests a wifi access

[@Vision06]

Into for the fun - meanwhile people with power pricing like in Germany be like 😢 Ah well, people like Wolfgang understand this 😬 Also have to say: it’s kinda wild what some homeland folks are willing to spend time and money on. I’d think 90% is overload, as you said yourself. Anyhow, cool video, thanks for sharing.

[@joeybagapot9961]

You can move traffic rules?

[@What_s_Neu]

15:18 man I wish you could do a video about what's in my timestamp but it's understandable. A unifi network video would be cool though!

[@RaidOwl]

Yeah I’d love to do a video on it…maybe I can get creative ;)

[@What_s_Neu]

@@RaidOwl I mean.. you are witty and slick with dropping some subtle hints

[@user-lb8ny2cb9p]

What LAN did you put your local Synology in?

[@dominick253]

I need some inspiration. I feel like I've done everything I can do with q homelab. Setting up a hack the box kali vm RN. Hopefully that'll spark my interest.

[@pelic4n497]

See and I'm over here with the opposite problem, all these year end Homelab Tours have me looking at my simple setup and wondering what I can start doing to clean up and organize it all better. This video has added no less than 4 different software services for me to dig into and I don't have the time or budget to do that. My wife is going to kill me.

[@dominick253]

True! I ended up setting up a local AI and integrating it into my website. Was a fun project! But again back to square one. Thinking about setting up a Ethereum node. Idk I would need better security though.

[@EightyAnthony]

forgive me but why would you ask if we want a network walk through? duh. I have always wondered what the ui of ubiquity looked like and it looks really good. I really want to know what software you use to show us the infographic of everything in your presentation. I looked through the great list you have and it's probably there? I couldn't figure it out. I have never seen such a clear infographic flow chart and I am constantly trying to learn about networking.

[@DangoNetwork]

sugguestion. Change your 12 drive pool from 3 x Raidz to 2 x Raidz2. 12TB rebuild could take 5 days and the chance of 2nd drive fail during that time is much higher.

[@RaidOwl]

It was initially a 8 drive pool (2x raidz). It was easier to add another raidz vdev. I’ll revisit it one day.

[@boneappletee6416]

I'd be interested in your r-stack - sonarr, shlink, and "Linux ISO and news articles" downloader

[@le0d406]

I m curious to know how you route your nextcloud to out of your Lan ?

[@RaidOwl]

Nginx proxy manger

[@bobsuruncle4a]

Would like to see a network walk-thru. What are you using for your diagrams?

[@RaidOwl]

Draw.io

[@bobsuruncle4a]

Thank you!@@RaidOwl

[@TheGenius0]

As much as this makes my head hurts cause I don’t understand most of it and my current server is just media but definitely cool to learn more about servers and hope to get to tahr point where all this sounds like English to me

[@RaidOwl]

Well feel free to join the Discord if you want to learn more :)

[@rx2gamingofficial]

What exactly is your cloudflare doing besides just load balancing for the dual WAN?

[@RaidOwl]

DNS so it points all my domains to my public IP

[@rx2gamingofficial]

@@RaidOwl Thatnks for the crazy fast response! Now that I've looked into it more, I might start using this for my domains that I have locally hosted.

[@definitelycasualpcs8789]

I have a small home server I built but I don't run many cool services since I haven't quite figured out how to port forward from my router. Otherwise I'd probably be running... Ok tbh I'd be an idiot and try to run to many off my small outdated hardware server lol

[@RaidOwl]

Haha that’s the fun of homelabbing

[@PowerUsr1]

Did I miss a clip of what you’re doing for network and system monitoring?

[@RaidOwl]

Uptime kuma

[@FrancescoCarucci]

What bugs are you seeing? I've been using WG on mac from a UDM PRO SE for a year now with no issue. Let me know if I can help. I also have a tailscale backup (and a LT2P backup of the backup just in case). I have the same vpn client set up (just using expressVPN) and routing the guest network there, smart choice buddy, you never know what they do on your guest network. The only small difference is that I have my guest network completely open, because I'm good at heart :) I also watch Pirates of the Caribbean on loop...

[@RaidOwl]

It just wouldn't connect from my Macbook, but the same config worked in Windows. This was probably a few months ago at this point so I'd assume something has been patched to fix it. I'll have to try again.

[@osaether]

What about separating smart home (IOT) devices between those that don't need internet access and those who does? Some (me included) name the non-internet Vlan: "NOT" and the internet-enabled Vlan "IOT"

[@RaidOwl]

Good call

[@tiju000]

One question that always come to my mind with homelabs is why not use services like AWS or Azure. The companies are going that way would it be cheaper in equipment and electricity. Ok probably less fun because we dont have full control…

[@RaidOwl]

I like the hardware part just as much as the software. I do run some cloud stuff though.

[@Scranny]

Can you explain in simple terms how do you connect a new device to a particular subnetwork *in advance* before it can make the first "call home" or poll your other devices on the network? How does your answer change if I have a single simple router running OpenWRT?

[@RaidOwl]

You configure the port that you’ll plug it into. Or set a static ip on the device. I prefer the former.

[@Scranny]

@@RaidOwl thank you! If it's a WiFi device only (like a robot vacuum), is there a non physical way to do it? Should I create a temporary guest WiFi network which cant access the Internet?

[@RaidOwl]

Yeah you can create an SSID then use firewall rules to restrict access to the internet.

[@ThatRandomDude914]

You should disable GNOME in your Plex VM so it doesn’t use GPU power. Do systemctl disable gdm And then reboot or run systemctl stop gdm I recommend a reboot but you do you

[@wodn184fn8]

i want a fully network setup work through so make it😅

[@shephusted2714]

instead of opening ports why not just get a vps and run your own vpn and then use reverse proxy to expose services and tunnels to browse web - you can close all ports and get a more protected lan with less arduous fw rules - additionally you should probably get dual nas and use 40g point to point - no switch needed plus you have upgrade path to 100g - hopefully you will be able to move to multi gpu ai box at some point and be able to run bigger models - I suspect most of the mkt will wait for prosumer mi300 in 3-4 years with cxl expander - that combo whould really open things up substantially and provide greater economies of scale - you will be able to run models that require 200gb vram with no issues or in other words 3x bigger than where we are today with 70b models

[@chucknorris994]

Ubuntu 20.04 LTS - Season 1, the best TV Show!

[@DanielC-om7fc]

i don't know why my comments are not showing. I was saying instead of NPM, why not trying cosmos cloud ? (and do a review about it ?) it is a new project, but seems good. As NPM seems not to be well maintained (still no news of version 3....)

[@RaidOwl]

NPM does everything I need and does it with 0 issues so I’ll continue to use it. I’m not opposed to trying out new stuff though.

[@jganer]

What tool did you use to map your network like that?

[@RaidOwl]

draw.io

[@jothain]

Does CEPH need "identical" hardware and does it handle like supercomputer and small NUC? Yeah, yeah wildly over exaggerated, but you get the gist.

[@neccros007]

Can we get a copy of your network diagram?? I am trying to learn and wrap my head around how it all works and what runs what... Lame but its how I learn sometimes... Also what did you use to create that diagram???

[@RaidOwl]

Yeah I’ll get a download link in the video description soon. And I used draw.io

[@neccros007]

@@RaidOwl Cool! Where did you source the software logos and equipment images??

[@RaidOwl]

@@neccros007 Google and the "walkxcode/dashboard-icons" github

[@neccros007]

@@RaidOwl What terms did you Google to find transparent logos/images? A lot of what I find are not transparent

[@hyperprotagonist]

The amount of times I paused this video, my finger hurts. Great presentation.

[@thespencerowen]

What diagram software is that?

[@RaidOwl]

Draw.io

[@truth884]

Can we see your networking process?

[@RaidOwl]

Soon

[@truth884]

Thanks my dude! You are appreciated.

[@pepeshopping]

A better setup would be BOTH WANs active and being used. Unnecessary to pay for a load balancer if you knew how to do it locally.

[@RaidOwl]

I don’t need the extra bandwidth and this works well for me

[@andresbravo2003]

This is where the server gets HUGE…

[@RaidOwl]

Uuuuuuuuge

[@caydenevans8186]

I think this probably cost a lot of money. That’s why I am running EVERYTHING on my optiplex 3010

[@joseph3164]

ah yes very regular basis!

[@FCB19873]

Nice setup. But on Windows server part, you shouldn't have all those roles running together, especially with AD DS, but I bet that's just for a learning 😉

[@RaidOwl]

Oh it’s 100% for learning haha

[@GeronimoJenkins]

Omada gang represent

[@AaronMolligan]

Surprised your not using traefik for your prxoy routing considering you have so much services pointing externally

[@RaidOwl]

I use Traefik with my k3s cluster for ingress. Npm for everything else tho.

[@rodneycrosslin4405]

UniFi Camera Proxy

[@pepeshopping]

Ha! Using proprietary hardware and software for your trusted backups eh. A real pro would have at least 2 of them, for when one fails. Gotta love the overdone systems with 32 CPUs, less than 20% utilization and lots of wasted energy. I have settled 100% on Truenas Scale, even for storage only (same OS and interface). A tiny bare still, but will get all the features and niceties within the next 2 releases. Yes, got rid of ESXi and Proxmox, as I want a ONE configuration file, ONE click, FIVE minute, FULL config restore SOLUTION. Plus I can manipulate the software and database and do everything I want/need. How long would it take to get a failed Proxmox server working exactly as it was? Have notes, scripts and time for 100% of the settings? With TS Scale, started to shutdown the secondary backup machines (where backups only happen in the afternoon) , and all the redundant/backup and backup of the backup machines daily and using the RTC timers to turn them on next afternoon to get the backups and replicate. Surprised how well it is working and the energy saved.

[@RaidOwl]

Well good thing I'm not a real pro

[@bigpod]

kubernetes isnt complex its flexible

[@RaidOwl]

those aren't mutually exclusive

[@bigpod]

@@RaidOwl yes but people confuse the 2 when it comes to kuberentes, in my opinion basic kubernetes is really really easy and does everything for you and people make it complex