My Proxmox Home Server ... (GPU Passthrough, IOMMU Groups and more)

► Follow me!
𝕏 ►► x.com/@MichaelNROH
📷 Instagram ►► / @michaelnroh
🤖 Discord ►► / discord
#️ Matrix ►► matrix.to/#/#michaelnr0h-community:matrix.org
▶️ Second Channel ►► / nr0hofficial
----------------------------------------------------------------------------------
Links:
Homelab Server ►► • My Own Homelab Server ...
Server Parts ►► amzn.to/43Y7441
Proxmox VE ►► www.proxmox.com/en/proxmox-vi...
(* All Amazon Links are affiliated. That means that I get a small cut of revenue if you buy something, without any additional costs.)
----------------------------------------------------------------------------------
🎵 Music from StreamBeats by Harris Heller.
----------------------------------------------------------------------------------
Chapters:
00:00 - Your own Virtualization Server
00:49 - What is Proxmox VE?
01:51 - How to install Proxmox & UEFI/BIOS settings
04:51 - The Proxmox VE - Web GUI
06:01 - Setting up a ZFS - Pool (RAIDZ)
06:14 - Multi-Factor Authentication
06:53 - The difference between Linux PAM and Proxmox VE
07:25 - Setting up a Virtual Machine (ISO Upload, Templates, QEMU Virtual Agent)
08:51 - Fix: No disks available when installing Windows (VirtIO - Drivers)
09:25 - GPU and PCIe - Passthrough
10:19 - IOMMU Groups and how to split them up (UEFI settings & ACS Kernel Patch)
14:27 - Conclusion
----------------------------------------------------------------------------------
Description Tags:
virtual machine, gpu passthrough, gpu pass through, proxmox, proxmox install, proxmox cluster, proxmox ve installation and configuration, proxmox ve, proxmox ve 8, proxmox gpu passthrough, proxmox iommu, proxmox iommu enable, iommu groups proxmox, iommu groups, linux acs kernel patch, host crash gpu passthrough, proxmox tutorial, proxmox tutorial 2023, linux, open source, uefi virtualization, michael horn, home, server
----------------------------------------------------------------------------------
#proxmox #linux #opensource

[@axonn101]

This video is incredibly helpful. Planning on building a server feels overwhelming when people just say “I installed Proxmox” as though everyone just knows what that is. This video demystifies Proxmox.

[@impopet]

Looking forward to the low latency remote session video Michael. Great work! Also looking forward to the fiverr video next year ;)

[@victorc777]

Thank you! Very helpful! That kernel patch was exactly what I was looking for!

[@joh551]

3 day's and countless video's and F*&K FINALLY THANK YOU!!!

[@moris7361]

Awesome!!! keep these types of videos coming!!!

[@MichaelNROH]

🫡

[@josephjohn3089]

Thanks , well explained. In short time

[@Abdo70t]

wooow great video very helpful ❤

[@rayfushgo]

Very cool, and just what i was looking for. Please don't wait too long with the low latency rdps 🙏

[@EmpressHsiao]

Thanks a lot, the IOMMU grouping saved my day

[@MichaelNROH]

Glad I could help

[@gilbertrodriguez6053]

By far the most complete way to setup gpu passthru. Thank you!

[@MichaelNROH]

❤️

[@YannMetalhead]

Good video!

[@RobertWelchman]

Looking forward to the low latency tutorial. Thanks!

[@ilyajeibar4041]

This is some high quality video, It would be great if you create a video about gpu passthroughing, many people in Linux realm tries single gpu passthroughing and learns it the hard way.

[@ransacked]

Not really worth it anymore with so many companies blocking VMs due to anti cheat. I used to be a firm believer in single gpu pass-through but as the kernel has updated and companies have updated their anti cheats to block VMs its really not as good as it used to be.

[@MichaelNROH]

Yeah, it's the unfortunate truth sadly. I actually would love to get rid of my Desktop PC completely and only use Virtual machines and notebooks, but Gaming is just not realistic that way

[@asunavk69]

@@ransacked i personally don't really care and use vms any further for gaming, there will allways be overhead, and most of these "anti-cheat" games use the discusting microtransaction formula, pretending 2be f2p friendly lel.

[@nirv]

I just built a proxmox PC and did a GPU passthrough to get Quicksync hardware decoding for Jellyfin the other day. You probably don't mean an igpu passthrough do you? It wasn't too hard. If you need a tutorial for that I think I can make an easy one.

[@ilyajeibar4041]

@@nirv Im on a laptop (by choice) passing the dedicated gpu is a no go, whole system feels crappy. I thought KVM uses iGpu by default, if passing it through would help the vm that would be awsome.

[@4VPme]

Michel, Thank you!

[@agfreelance]

Thanks!

[@MichaelNROH]

Wow, thank you much ❤️

[@fstoplive1991]

You stay on topic & straight to the point! Excellent video could you explain the difference be setting up a 'Headless Proxmox Home Server vs One with a WM console? Can you configure Proxmox from the server itself via Linux CLI? Can you recommend mother boards that also have the ACS Enable option? Will you be making more Proxmox Single User HomeLab videos for running w/linux? How about installing Sessions secure messaging app or mastodon decentralized communication app? Headed to checkout what videos for Proxmox you've created. What I like best about your video is that you don't waste my time with useless extraneous commentary👍 thank you

[@MichaelNROH]

Those were a lot of questions. Generally speaking a headless system with Proxmox might still need a GPU, depending on if the motherboard allows booting without one. Since Proxmox is just a lightweight Debian Distribution, it's possible to execute commands straight on the host. You can switch to a shell with Ctrl+Alt+F2. When it comes to ACS support, most "top tier" mainboards like the X-series for AMD or Z-Series for Intel support it out of the box. Hosting secure social media applications is technically possible since you can set them up in containers or for better security in virtual machines, however you would also need to take a look at Proxmox and Linux firewalls, as well as firewalling in general. Running something public is always a risk factor.

[@daphnesplyntr]

Thank you

[@MichaelNROH]

Happy to help 😉

[@shephusted2714]

this was a good look at complex problems with vms - pls followup

[@jcarman]

@MichaelNr0h - is it just me, or did Proxmox take away the "all functions" checkbox in VE8? Awesome video, thanks so much man! I'm working on setting up a mini PC (Beeline GTR 7) with a Radeon 780M passed through to a LXC container running Docker. I'm sure I'll have more questions! :)

[@MichaelNROH]

No, it's still there in VE8

[@sergeiborodin9254]

Hi, Michael! Thank you for such informative video! I wonder if CPU isolation is possible with dual-CPU motherboards? I mean CPU 1 dedicated to Proxmox and lightly loaded VMs, and CPU 2 dedicated to specific VM.

[@MichaelNROH]

That would depend on how the mainboard is built. Technically speaking, it should be possible since many mainboards completely seperate the sockets, but that's no guruantee

[@mdhurrtn]

Great video, thanks for the information. One question, can proxmox 8.1.3 have two virtual machines(truenas scale using a PLEX application and jellyfin installed as a virtual machine) share a hard drive(s) that is on a smb share? Would I need to use pcie sata adapter or can I identify the hard drives by there serial numbers in the configuration files? Thanks.

[@shaital6653]

Any chance you have/know of any guides/tutorials for setting up a Kubernetes PaaS running on Proxmox? a startup im working with has a pretty beefy on-prem server with 8 Nvidia H100 GPUs. Any advice, feedback would be truly appreciated!

[@asunavk69]

After selling my clevo P65 laptop and buying a lenovo legion 5, i am now exited to see if i can passthrough and take advantage of that nice rtx gpu on a vm 🤤🤤lul.

[@dexterman6361]

Actually you can enable secure boot if installing over debian. For proxmox itself though, not sure. Custom keys? It's still nice to have imo. And custom partitioning was why I went the debian route Great video

[@MichaelNROH]

Proxmox also supports this now. It has been enabled since Kernel 6.2.16-8, so not that long ago, but yes, the Debian way is still way better for partitioning

[@dexterman6361]

@@MichaelNROH Oh wow didn't know that! Also, I stumbled across your channel a while back. I was on the fence about switching completely to linux because edge replaced my search engine with bing. Watched a few videos of yours and got a little more confident and can say, am a happy user of Fedora for about 2 weeks now. Started the new year with Linux. Thanks for the videos!

[@emilemouannes2236]

Thanks a lot. What is your 4u case and rail model? Did you have to drill holes in the case to align the rail properly?

[@MichaelNROH]

No I didn't need to modify the case. You can find the model in my description

[@Jose-yu2pd]

Amazing! How the audio editing? Any lags

[@MichaelNROH]

I'm still using DaVinci Resolve which caches the files locally, so it's not any different for now. My backup or remote VM is going to use Moonlight (with Sunshine), but I haven't tested it that extensively yet.

[@choppergirl]

Can Proxmox pass through USB ports on the motherboard for Corsair ICue to to control Corsair RGB lighting on the Proxmox server?

[@MichaelNROH]

If it's recognized as a USB device then yes. Passing through the port entirely depends on your mainboard, since it might need the controller for that

[@megamodspc6436]

what about a video about GPU passthrough, but natively with kvm

[@kienhwengtai8113]

VMWare tried GPU passthrough in ESXi but gave up eventually.

[@Alex-fl2yh]

I want to stream games to my laptop from a home server. How do you do that? Do you use parsec, moonlight or something like this?

[@MichaelNROH]

Moonlight if you like Open Source, and Parsec if you need dual monitor support, but that's more of a Remote Desktop thing

[@newplayer7743]

good, initially i thinking, the hell waht is promox, and then, owh, kinda similar to qemu lol

[@MichaelNROH]

Well, it uses both QEMU and KVM to virtualize, that's why. The difference is how it's implemented. Proxmox is supposed to be a fully fledged virtualization solution while QEMU just allows you to virtualize. It also exposes more functions through the GUI and ships a lot of custom adjustments and packages which makes it more compatible with other platforms.

[@vikrantsingh3923]

thank you for the explanation. I followed this process but inside my vm i get an error when i try to run nvidia-smi "NVIDIA-SMI has failed because it couldn't communicate with the NVIDIA driver. Make sure that the latest NVIDIA driver is installed and running." I'm doing this on a supermicro server that has 4xNvidia A40 GPUs.

[@MichaelNROH]

Is it still a PCIe card? There is a checkbox if you enable the advanced menu in the passthrough window.

[@vikrantsingh3923]

@@MichaelNROH PCIE option is selected. ROM bar and all functions are also selected. I could not enable the Primary GPU option because if i do, the vm fails to start.

[@InsaiyanTech]

please do a how to setup a arr stack in lxc containers with a vpn tunnel

[@Pastor_virtual_Robson]

pra quem tem dinheiro e tempo para jogar fora , legal.

[@ShawnKirk007]

I have a question you did not cover. In other videos, Proxmox takes the entire drive you install it on. You can not install anything else on it. You have to have other drive(s) setup in volumes. So as an example, if I want to install Proxmox on the 512GB NVMe drive, but Proxmox is only 8GB when installed, then the rest of the 504GB remaining on the NVMe is no longer usable. This seems like a really poor use if you lose 504GB worth of space. I noticed in the other videos, they are using small 20GB-32GB drives instead. Is this really how Proxmox installs? Do I need to find a smaller drive so I do not waste a 512GB NVMe on it?

[@MichaelNROH]

No. While Proxmox claims the whole drive for itself if you use their installer, only a part of the drive gets the OS, while the rest becomes a local Storage for ISOs and VMs. I'm using a 256 GB drive and I can use 64 GBs for ISOs, files and backups, and another 130 GBs for VMs (Proxmox supports different use cases).

[@ShawnKirk007]

@@MichaelNROH ... thanks for the extra info, mate! I'll be installing it tomorrow then. I have a 512GB NVMe and was worried I'd waste all the extra space. It's a small Mini-ITX motherboard so space is limited. It's my first go at ProxMox so it's more of a test system versus a production system. I'm learning.

[@jensg.5256]

But what about Error 43 on nvidia after install driver in vm?

[@MichaelNROH]

You might need to enable PCIe in the Advanced Settings when adding the PCI device

[@Mohamed_Fayyad]

Is it suitable for making VMs on the local machine and not on the server?! Or is there a better and simpler option to work on the local machine?

[@MichaelNROH]

Proxmox is Debian based, so you'll need a related distro for an afterwards installation as well. Technically speaking, if you want to just virtualize on a Desktop, then your best bet would be to download "virt-manager" and use that. It's essentially the same technology as Proxmox, since it uses KVM and QEMU, and better suited on workstations.

[@Mohamed_Fayyad]

​@@MichaelNROH Is the "virt manager" available for Windows as well? I use Linux Mint for Windows, and I want one software that works on both systems, so that I reduce distraction and switch between applications.

[@MichaelNROH]

@@Mohamed_Fayyad No, that wouldn't work. What you are looking for are Type-2 Hypervisors which run on top of operating systems. They are a bit slower by default but it's not all that bad on Desktops. The most used application would be Virtualbox

[@Mohamed_Fayyad]

@@MichaelNROH Thanks Michael for the great effort on the channel and for helping me, I wish you success ❤✨

[@berwickcomputers]

Can you please please answer one question for me, if I pass thru the gpu can I see a Windows 11 VM on the proxmox server with a monitor connect to that gpu.... I guesse what I am asking is will the gpu out a signal to a monitor

[@MichaelNROH]

Yes, you can. Passing the GPU through, will in fact pass the full GPU. Its best if you CPU also has an Onboard GPU as well, as otherwise, Proxmox might not like it if you rip its only output away for a VM. I think they have a guide how to not load kernel drivers at boot if you search for it

[@berwickcomputers]

@@MichaelNROH thanks you for the quick reply and the reason for this is to use the proxmox server screen is to run a Windows client for security cameras as well as using it for a nas.... I really didn't want to run a computer pc with window just to run surveillance station

[@berwickcomputers]

Note I have the on board Intel gpu and I am trying to pass thru the nvidia p620 quaddro

[@WillFuI]

Now if u don’t have iommu on when u install proxmox does that break stuff?

[@MichaelNROH]

It shouldn't unless some group would get re-assigned a different number, but even then the VMs would probably still start, just without the assigned device. On the Proxmox host itself it should have no impact.

[@WillFuI]

@@MichaelNROH ok because no nic’s arent picked up so I can’t get into the gui

[@makratorianeagle-id9sd]

Can i use it on Steam deck ? I need a windows vm, windows dual boot is acting up

[@MichaelNROH]

Proxmox is technically designed to be run on bare metal, so I wouldn't really recommend the Deck for it. Technically it could work, but you just introduce a lot of overhead and problems when running SteamOS in a VM

[@makratorianeagle-id9sd]

@MichaelNROH no i meant running windows in a vm in steamos i got boxes working really fast but got no gpu pass-through

[@digitalpostman]

I dont have "Resource Mappings" ...

[@MichaelNROH]

Resource Mappings is a Cluster functionality that comes with Proxmox VE8. Older versions are not supported

[@digitalpostman]

OK. thanks. I am using V7.4@@MichaelNROH

[@prettysheddy]

Why did you choose promox over xcpng?

[@MichaelNROH]

Because of KVM. The Xen-Hypervisor is a bit unnecessary if you already have a hypervisor built into Linux

[@prettysheddy]

@@MichaelNROH kvm and xen are both great hypervisors. I use promox myself but xcpng has native ova/of imports which is great because most companies use that format. Also gui for vm exporting

[@eglinfo1]

why don't you run a vm instead of all that junk. just hell to use. better install virtualbox. I have a proxmox server but i works so bad in use virtualbox insteda

[@estusflask982]

Why doesn't copy paste work?

[@MichaelNROH]

It's a security measure, but also a general limitation by design. You shouldn't forget that the noVNC-session is running on the host (QEMU) and not on the client with the open interface. There are some methods how you can enable it, but the most convinient way is just ot open up an SSH or Remote Desktop session

[@Thomas88-_-]

Man I have 2 full drives of movies and TV. I'm trying to set up but everyone always shows how to make a pool. I don't want to loose me 30tb of data I just want it running of those drives lol

[@rinket7779]

Is it just me or he didn't say something quite crucial -- proxmox does NOT work with wifi - you'l lhave to plug the ethernet cable directly into your proxmox box. I don't know why everyone skips saying this, it's not at all obvious and is a pain in the ass once you realize.

[@MichaelNROH]

I mean, that's not really all that true. You just need to so a bit more setting up since it defaults to the RJ45 ones. Proxomx runs on a customized and stripped Debian OS. Everything that Debian can do, Proxmox can