Proxmox Network Configuration - How To Create LACP Bonds - 2x 40Gbit Homelab Networking

[@TheSasquatchjones]

You're going to make me buy a mellanox switch 😂. Great video.

[@DigitalSpaceport]

40Gb gear is rather cheap

[@XtianApi]

I've been scrolling through your videos looking for one that explains what you do/host with/on your massive datacenter. Do you have a video that covers your use case or reasoning for your decisions? Thank you

[@DigitalSpaceport]

I work in rendering very large geographic areas. Digital twinning is an industry term. In the past this was done largely with massive CPU cores but gpu raytracing has come a long way now so the R930s are pretty much obsolete now. I am working on a migration to GPU tech but its not well suited to racks imho. Might fabricate something. Also storing the GIS data is preferred and most projects are pretty massive. Its all work stuff that's in the garage which might be a boring use case.

[@XtianApi]

@@DigitalSpaceport very cool. That's awesome. I work in the utilities space for many years and by far the largest space allocation in the datacenter was gis data. And that was just for staking. Nothing special graphically. It's the only me I heard things like: "hey, we just need like 30 TB more space to get through this next thing". Meanwhile other departments ask for 50gigs, lol Thanks for the reply!

[@tubeeichi81]

Shouldn't be the "Autostart" kept unchecked on physical interfaces when they are in a bond/bridge?

[@HomeSysAdmin]

What is that VLAN tab on the Proxmox network interface list? Does it support passing multiple tagged VLANs in on the same interface and bridging them individually to different VMs?

[@DigitalSpaceport]

The Linux VLAN tab option in proxmox allows for creating a single VLAN tag raw interface that can be shared among several virtual machines on a per host basis. You can create as many of those and assign as many of those as you would like to vms. This is in contrast to the ability to create multiple tagged interfaces at the machine interface level (outside VM guest). I think of it as a special vlan device kind of like a vlan switch. Its awesome if you create a lot of machines and want segments on some hosts and not on others and for them to pass traffic from a vlan mgmt perspective. Both variants are limited to a single tag, you have to be inside the VM guest if you want to specify multiple vlan tags. Im not sure what the 3 Openswitch (OVS) options look like, those are way over my head.

[@HomeSysAdmin]

@@DigitalSpaceport Ok so if I'm following - you need 3 physical connections back to the switch if you have 3 VMs and want each VM to be on a separate VLAN. I've been trying for quite a while to figure that out with nmcli and have been rather unsuccessful. I can create multiple VLAN virtual interfaces but can't bridge to them with the VMs. Anyway, was just curious. I'm heavily considering a rebuild with Proxmox now that the chia farming "stuff" is off on it's own dedicated hardware.

[@HomeSysAdmin]

There's also ovirt which I've been looking into as well - though it seems overly-complex for the homelab use.

[@DigitalSpaceport]

Ovirt is as complex as it comes. Proxmox is indeed the way. Comment on the way on other question.

[@DigitalSpaceport]

Nope. You can set your Linux Bridge to VLAN aware and any phy device slaves on that will be able to properly tag traffic. You then set the VLAN tag on the machines virtual nic. You would need to attach multiple virtual nics for each tag.

[@hprompt166]

Hi There, I have 2 dell r720 running pve 8.2.4, connected by 2 1gig links to a cisco 3750 switch. I can get one pve to connect to the switch using lacp for the bond0. the other pve won't connect. same configuration for both bond0s. If you want more info let me know thx

[@DigitalSpaceport]

I hope you got this fixed but I dont know anything about cisco switches myself. Should be these steps in the switch and the steps I outlined here on the R720's. Also have you tested to the underlying Debian install? That would be where I would test if I had an issue with networking first. Also dont forget to hit apply in Proxmox, has happened many times to me. www.cisco.com/c/en/us/td/docs/ios/12_2sb/feature/guide/gigeth.html#wp1089298

[@hprompt166]

@@DigitalSpaceport Hey There, I got it going by using a different port-channel on the same switch for each pve1 = po3 and pve2 = po2. I'm using a cisco 3750-24ps PoE switch. if you want to know more let me know. thx for your reply to help

[@arva1kes]

Are you sure it actually works as 80gb net also? proxmox manual states that there is no performance gains. Just redundancy.

[@JzJad]

I too would not use that dell power connect 😂

[@enzo21brn]

How to config LACP with VLANs?