My Proxmox Home Server ... (GPU Passthrough, IOMMU Groups and more)

[@axonn101]

This video is incredibly helpful. Planning on building a server feels overwhelming when people just say “I installed Proxmox” as though everyone just knows what that is. This video demystifies Proxmox.

[@joh551]

3 day's and countless video's and F*&K FINALLY THANK YOU!!!

[@victorc777]

Thank you! Very helpful! That kernel patch was exactly what I was looking for!

[@EmpressHsiao]

Thanks a lot, the IOMMU grouping saved my day

[@MichaelNROH]

Glad I could help

[@gilbertrodriguez6053]

By far the most complete way to setup gpu passthru. Thank you!

[@MichaelNROH]

❤️

[@agfreelance]

Thanks!

[@MichaelNROH]

Wow, thank you much ❤️

[@impopet]

Looking forward to the low latency remote session video Michael. Great work! Also looking forward to the fiverr video next year ;)

[@moris7361]

Awesome!!! keep these types of videos coming!!!

[@MichaelNROH]

🫡

[@4VPme]

Michel, Thank you!

[@josephjohn3089]

Thanks , well explained. In short time

[@rayfushgo]

Very cool, and just what i was looking for. Please don't wait too long with the low latency rdps 🙏

[@jcarman]

@MichaelNr0h - is it just me, or did Proxmox take away the "all functions" checkbox in VE8? Awesome video, thanks so much man! I'm working on setting up a mini PC (Beeline GTR 7) with a Radeon 780M passed through to a LXC container running Docker. I'm sure I'll have more questions! :)

[@MichaelNROH]

No, it's still there in VE8

[@LA_318]

The up talk on this one is strong!

[@fstoplive1991]

You stay on topic & straight to the point! Excellent video could you explain the difference be setting up a 'Headless Proxmox Home Server vs One with a WM console? Can you configure Proxmox from the server itself via Linux CLI? Can you recommend mother boards that also have the ACS Enable option? Will you be making more Proxmox Single User HomeLab videos for running w/linux? How about installing Sessions secure messaging app or mastodon decentralized communication app? Headed to checkout what videos for Proxmox you've created. What I like best about your video is that you don't waste my time with useless extraneous commentary👍 thank you

[@MichaelNROH]

Those were a lot of questions. Generally speaking a headless system with Proxmox might still need a GPU, depending on if the motherboard allows booting without one. Since Proxmox is just a lightweight Debian Distribution, it's possible to execute commands straight on the host. You can switch to a shell with Ctrl+Alt+F2. When it comes to ACS support, most "top tier" mainboards like the X-series for AMD or Z-Series for Intel support it out of the box. Hosting secure social media applications is technically possible since you can set them up in containers or for better security in virtual machines, however you would also need to take a look at Proxmox and Linux firewalls, as well as firewalling in general. Running something public is always a risk factor.

[@Abdo70t]

wooow great video very helpful ❤

[@Alex-rg1rz]

very good video, thanks

[@YannMetalhead]

Good video!

[@ThatShaiGuy_Official]

Any chance you have/know of any guides/tutorials for setting up a Kubernetes PaaS running on Proxmox? a startup im working with has a pretty beefy on-prem server with 8 Nvidia H100 GPUs. Any advice, feedback would be truly appreciated!

[@mdhurrtn]

Great video, thanks for the information. One question, can proxmox 8.1.3 have two virtual machines(truenas scale using a PLEX application and jellyfin installed as a virtual machine) share a hard drive(s) that is on a smb share? Would I need to use pcie sata adapter or can I identify the hard drives by there serial numbers in the configuration files? Thanks.

[@RobertWelchman]

Looking forward to the low latency tutorial. Thanks!

[@dexterman6361]

Actually you can enable secure boot if installing over debian. For proxmox itself though, not sure. Custom keys? It's still nice to have imo. And custom partitioning was why I went the debian route Great video

[@MichaelNROH]

Proxmox also supports this now. It has been enabled since Kernel 6.2.16-8, so not that long ago, but yes, the Debian way is still way better for partitioning

[@dexterman6361]

@@MichaelNROH Oh wow didn't know that! Also, I stumbled across your channel a while back. I was on the fence about switching completely to linux because edge replaced my search engine with bing. Watched a few videos of yours and got a little more confident and can say, am a happy user of Fedora for about 2 weeks now. Started the new year with Linux. Thanks for the videos!

[@ponchobob]

Thanks for your video. I've openmediavault running in a VM and have passed through my two hdd drives (qm set -scsi....). Would passing through sata controllers make it possible for th eomv vm to show SMART parameters and to spin down the hdd ?

[@MichaelNROH]

Depends on your mainboard. If you use the inbuilt Controller for passthrough, then sometimes the Disk containing Proxmox is also being passed through which results in a crash. If it's a dedicated one, then it is technically possible

[@shephusted2714]

this was a good look at complex problems with vms - pls followup

[@kienhwengtai8113]

VMWare tried GPU passthrough in ESXi but gave up eventually.

[@emilemouannes2236]

Thanks a lot. What is your 4u case and rail model? Did you have to drill holes in the case to align the rail properly?

[@MichaelNROH]

No I didn't need to modify the case. You can find the model in my description

[@sergeiborodin9254]

Hi, Michael! Thank you for such informative video! I wonder if CPU isolation is possible with dual-CPU motherboards? I mean CPU 1 dedicated to Proxmox and lightly loaded VMs, and CPU 2 dedicated to specific VM.

[@MichaelNROH]

That would depend on how the mainboard is built. Technically speaking, it should be possible since many mainboards completely seperate the sockets, but that's no guruantee

[@y2b5]

Thank you

[@MichaelNROH]

Happy to help 😉

[@asunavk69]

After selling my clevo P65 laptop and buying a lenovo legion 5, i am now exited to see if i can passthrough and take advantage of that nice rtx gpu on a vm 🤤🤤lul.

[@choppergirl]

Can Proxmox pass through USB ports on the motherboard for Corsair ICue to to control Corsair RGB lighting on the Proxmox server?

[@MichaelNROH]

If it's recognized as a USB device then yes. Passing through the port entirely depends on your mainboard, since it might need the controller for that

[@vikrantsingh3923]

thank you for the explanation. I followed this process but inside my vm i get an error when i try to run nvidia-smi "NVIDIA-SMI has failed because it couldn't communicate with the NVIDIA driver. Make sure that the latest NVIDIA driver is installed and running." I'm doing this on a supermicro server that has 4xNvidia A40 GPUs.

[@MichaelNROH]

Is it still a PCIe card? There is a checkbox if you enable the advanced menu in the passthrough window.

[@vikrantsingh3923]

@@MichaelNROH PCIE option is selected. ROM bar and all functions are also selected. I could not enable the Primary GPU option because if i do, the vm fails to start.

[@Alex-fl2yh]

I want to stream games to my laptop from a home server. How do you do that? Do you use parsec, moonlight or something like this?

[@MichaelNROH]

Moonlight if you like Open Source, and Parsec if you need dual monitor support, but that's more of a Remote Desktop thing

[@megamodspc6436]

what about a video about GPU passthrough, but natively with kvm

[@ShawnKirk007]

I have a question you did not cover. In other videos, Proxmox takes the entire drive you install it on. You can not install anything else on it. You have to have other drive(s) setup in volumes. So as an example, if I want to install Proxmox on the 512GB NVMe drive, but Proxmox is only 8GB when installed, then the rest of the 504GB remaining on the NVMe is no longer usable. This seems like a really poor use if you lose 504GB worth of space. I noticed in the other videos, they are using small 20GB-32GB drives instead. Is this really how Proxmox installs? Do I need to find a smaller drive so I do not waste a 512GB NVMe on it?

[@MichaelNROH]

No. While Proxmox claims the whole drive for itself if you use their installer, only a part of the drive gets the OS, while the rest becomes a local Storage for ISOs and VMs. I'm using a 256 GB drive and I can use 64 GBs for ISOs, files and backups, and another 130 GBs for VMs (Proxmox supports different use cases).

[@ShawnKirk007]

@@MichaelNROH ... thanks for the extra info, mate! I'll be installing it tomorrow then. I have a 512GB NVMe and was worried I'd waste all the extra space. It's a small Mini-ITX motherboard so space is limited. It's my first go at ProxMox so it's more of a test system versus a production system. I'm learning.

[@InsaiyanTech]

please do a how to setup a arr stack in lxc containers with a vpn tunnel

[@realJohnJohn]

so is it best to install debian and proxmox for home server nas, other services

[@MichaelNROH]

If you just want one server, then you don't need to virtualize with Proxmox. It's useful if you have more than one server you want to run

[@realJohnJohn]

@@MichaelNROH so install proxmox 1st and make vm of each server I need?

[@prettysheddy]

Why did you choose promox over xcpng?

[@MichaelNROH]

Because of KVM. The Xen-Hypervisor is a bit unnecessary if you already have a hypervisor built into Linux

[@prettysheddy]

@@MichaelNROH kvm and xen are both great hypervisors. I use promox myself but xcpng has native ova/of imports which is great because most companies use that format. Also gui for vm exporting

[@berwickcomputers]

Can you please please answer one question for me, if I pass thru the gpu can I see a Windows 11 VM on the proxmox server with a monitor connect to that gpu.... I guesse what I am asking is will the gpu out a signal to a monitor

[@MichaelNROH]

Yes, you can. Passing the GPU through, will in fact pass the full GPU. Its best if you CPU also has an Onboard GPU as well, as otherwise, Proxmox might not like it if you rip its only output away for a VM. I think they have a guide how to not load kernel drivers at boot if you search for it

[@berwickcomputers]

@@MichaelNROH thanks you for the quick reply and the reason for this is to use the proxmox server screen is to run a Windows client for security cameras as well as using it for a nas.... I really didn't want to run a computer pc with window just to run surveillance station

[@berwickcomputers]

Note I have the on board Intel gpu and I am trying to pass thru the nvidia p620 quaddro

[@makratorianeagle-id9sd]

Can i use it on Steam deck ? I need a windows vm, windows dual boot is acting up

[@MichaelNROH]

Proxmox is technically designed to be run on bare metal, so I wouldn't really recommend the Deck for it. Technically it could work, but you just introduce a lot of overhead and problems when running SteamOS in a VM

[@makratorianeagle-id9sd]

@MichaelNROH no i meant running windows in a vm in steamos i got boxes working really fast but got no gpu pass-through

[@AnthonyRichardson-t9o]

how do you create a VM pool?

[@MichaelNROH]

You define pools on the Datacenter level. There you give can give it a name and add VMs into it. Afterwards, it's best to use the "Pool View" on top of the left sidebar and you get a sort of folder view of all your pools.

[@WillFuI]

Now if u don’t have iommu on when u install proxmox does that break stuff?

[@MichaelNROH]

It shouldn't unless some group would get re-assigned a different number, but even then the VMs would probably still start, just without the assigned device. On the Proxmox host itself it should have no impact.

[@WillFuI]

@@MichaelNROH ok because no nic’s arent picked up so I can’t get into the gui

[@Jose-yu2pd]

Amazing! How the audio editing? Any lags

[@MichaelNROH]

I'm still using DaVinci Resolve which caches the files locally, so it's not any different for now. My backup or remote VM is going to use Moonlight (with Sunshine), but I haven't tested it that extensively yet.

[@digitalpostman]

I dont have "Resource Mappings" ...

[@MichaelNROH]

Resource Mappings is a Cluster functionality that comes with Proxmox VE8. Older versions are not supported

[@digitalpostman]

OK. thanks. I am using V7.4@@MichaelNROH

[@Mohamed_Fayyad]

Is it suitable for making VMs on the local machine and not on the server?! Or is there a better and simpler option to work on the local machine?

[@MichaelNROH]

Proxmox is Debian based, so you'll need a related distro for an afterwards installation as well. Technically speaking, if you want to just virtualize on a Desktop, then your best bet would be to download "virt-manager" and use that. It's essentially the same technology as Proxmox, since it uses KVM and QEMU, and better suited on workstations.

[@Mohamed_Fayyad]

​@@MichaelNROH Is the "virt manager" available for Windows as well? I use Linux Mint for Windows, and I want one software that works on both systems, so that I reduce distraction and switch between applications.

[@MichaelNROH]

@@Mohamed_Fayyad No, that wouldn't work. What you are looking for are Type-2 Hypervisors which run on top of operating systems. They are a bit slower by default but it's not all that bad on Desktops. The most used application would be Virtualbox

[@Mohamed_Fayyad]

@@MichaelNROH Thanks Michael for the great effort on the channel and for helping me, I wish you success ❤✨

[@newplayer7743]

good, initially i thinking, the hell waht is promox, and then, owh, kinda similar to qemu lol

[@MichaelNROH]

Well, it uses both QEMU and KVM to virtualize, that's why. The difference is how it's implemented. Proxmox is supposed to be a fully fledged virtualization solution while QEMU just allows you to virtualize. It also exposes more functions through the GUI and ships a lot of custom adjustments and packages which makes it more compatible with other platforms.

[@jensg.5256]

But what about Error 43 on nvidia after install driver in vm?

[@MichaelNROH]

You might need to enable PCIe in the Advanced Settings when adding the PCI device

[@Pastor_virtual_Robson]

pra quem tem dinheiro e tempo para jogar fora , legal.

[@estusflask982]

Why doesn't copy paste work?

[@MichaelNROH]

It's a security measure, but also a general limitation by design. You shouldn't forget that the noVNC-session is running on the host (QEMU) and not on the client with the open interface. There are some methods how you can enable it, but the most convinient way is just ot open up an SSH or Remote Desktop session

[@Thomas88-_-]

Man I have 2 full drives of movies and TV. I'm trying to set up but everyone always shows how to make a pool. I don't want to loose me 30tb of data I just want it running of those drives lol

[@eglinfo1]

why don't you run a vm instead of all that junk. just hell to use. better install virtualbox. I have a proxmox server but i works so bad in use virtualbox insteda

[@fliptight]

@@eglinfo1 what was it that worked bad for you in Proxmox

[@rinket7779]

Is it just me or he didn't say something quite crucial -- proxmox does NOT work with wifi - you'l lhave to plug the ethernet cable directly into your proxmox box. I don't know why everyone skips saying this, it's not at all obvious and is a pain in the ass once you realize.

[@MichaelNROH]

I mean, that's not really all that true. You just need to so a bit more setting up since it defaults to the RJ45 ones. Proxomx runs on a customized and stripped Debian OS. Everything that Debian can do, Proxmox can