Use ANY Headless GPU for Gaming in a Virtual Machine!

[@popcorny007]

This is like the peak of the mountain of troubleshooting! I can't tell you how satisfying it is to see such a clean and functional set up.

[@ornival6560]

"Do not check the primary GPU..." MY GOD! I have been struggling to get my GRID K1 and Tesla M40s working and just couldn't figure it out in PVE5, 6 and 7. Now I can finally ditch Server 2012 for the host OS. YOU ARE AWESOME!!!!

[@karter61]

"but this is craft computing annnd I'm Jeff" 😂 😂 😂

[@CraftComputing]

I know I'm about, son.

[@Barty.Crowell]

@@CraftComputing right at the "but" I thought "it'd be funny as hell if he... Omg he did it!". I laughed so hard I choked on what beer didn't go flying

[@monkeyrebellion117]

The man, not a myth, but a legend

[@irhyslee]

I know I'll never be doing any of this but the nerd in me loves these videos!

[@mkkohls]

Same here. I do an ebay search every time even though I have a Rx 6800XT in my gaming PC.

[@heinrichgroenewald6834]

Yeah, actual facts

[@PerfectT4ste]

Tesla cards aside, Jeff is without a doubt stepping up his beer game!

[@divyjotsingh3879]

It seems you've been pretty busy on your conquest Really enjoying your content !

[@cptwhite]

I will never do any of this, but it's so interesting to see you tinker :) You and Level1Techs are doing to great work in these niche areas of PC land.

[@ThatNerdIndy]

Glad I could help you with the usbmmidd driver. :D

[@CraftComputing]

It was a putting 2+2+2 together with everything else that made this happen :-)

[@edwardgreenjr167]

You are really making me prioritize building my server/workshop room before any other home improvement project. My NAS will not be happy sitting next to my desk for too much longer. Now I need get my v-machine box up and running....

[@brianbuckleygray994]

I was just starting to mess with my virtualisation monster when I got the notification for this video: windows server running on Unraid aiming to get GPU-P working so I could get rid of my dedicated Hyper-V machine. I listed my two M40’s on eBay yesterday because I didn’t have the time to figure out the display issues, this gives me fresh hope. Wish me luck!

[@dougm275]

I pass through an old XFX 7550 Ghost single slot to a VM. It's a fun toy and Mesa drivers are so much better these days.

[@moeness86]

Still contemplating about setting up a proper home lab, but for the time being, I just watch and learn from your shenanigans, and I just love it!

[@experiment18a40]

I'm going to try this setup. Thanks for the video, I've been looking into how to do this for a while now

[@ancestralpolitics7433]

This couldn't have come at a better time... I was just looking at using K80s (plus an older Threadripper) to run VMs for gaming for the family. I was unaware of the requirement that one VM of the two to not be running. Thanks so much for the heads up! It definitely decreases the interest level in using them (except for in the VM I'm going to be running for video streaming and gaming at once, but may look at different options for everyone else). I'm also going to second the community-driven FOSS Moonlight program. I find it to be better than Parsec at home and on par or slightly better over the internet.

[@pantoffels3440]

Wow, what a journey, let's do this ! Going to add Garuda gaming distro as well.

[@666nacirema666]

very cool. this is the exact sort of solution i was just looking into so my kids could play real pc games. honestly been thinking of setting my whole house up like this would save a lot of space we have 8 machines running here and i would love to consolidate that all into one rack.

[@inigma_]

It is midnight but a new video is a new video

[@baruchkata]

Lot of work to make this video. Great job sir

[@To-mos]

There are so many little clever tricks in this video it's admirable. Using a virtual display driver to force vnc to use another display driver so when noVNC shows up a blank screen the primary display adapter will be pushed through tightVNCs server. Then using the policy editor to force the screen on at each boot. THEN streaming a DirectX devices draw calls remotely with couch play software to fill in the gaps. All while benchmarking the second GPU on the same PCB in an adjacent VM, love it.

[@II_superluminal_II]

you seem to know alot about servers lol, why wont the virutal display driver run on my machine? The driver has a error 31

[@To-mos]

@@II_superluminal_II error 31 doesn't mean much without a lot of context. A few things suggest it's a permissions issue like the installer wasn't ran as administrator. It depends on what executable returned the error so that the error number corresponds to the appropriate lookup table.

[@MrBigSatchmo]

For everyone who wanna use this setup to run large language models, use type host in the cpu settings. Otherwise it can not use the shared gpu memory...

[@win7best]

Setting cpu to host also makes the vm run faster since you aren't emulating a specific cpu model

[@ProliantLife]

This Channel made me switch from desktop hardware to enterprise system. So cheap for so much performance with raid dual and quad socket cpu configurations and more

[@MrMoxes]

I wonder if this will work just as effective as Steam’s own “Steam Link”, if you pass a gpu via a VM and launch Steam itself inside of it.

[@CraftComputing]

You could use Steam link instead of Parsec for streaming, but the USBMMIDD setup would still be required to emulate a monitor.

[@ReturnJJ]

@@CraftComputing for a couple months when I had no monitor for my 1060, I used Steam Link to use my (now dead) MacBook Pro as a monitor for gaming, and I had no video output connected at all. No headless adapter, no usbmidd, none of the ports had anything connected at all. Parsec on the other hand, did not work, because it needs a video output device or monitor.

[@ahmetemin08]

It is cool but it doesn't support gpu virtualisation so you are limited to the count of gpu's you have. PCI passthrough is enabled on 30 series too. So you can also use them. They don't have to be headless, actually if they have hdmi ports it is better. Just plug them into monitors, passthrough usb ports to add keyboard, mouse etc to the virtual machines, then viola, you have multiple gaming computers running on a single server. Also using hdmi ports will remove the parsec's blurry gaming experience. It will be just like a physical computer. No additional configuration is needed! Just plug it and it works! Yet, a lot of games won't support virtual machines especially those with anti-cheat systems. They don't like to be run in virtual machines. Including CS:GO, valorant, LoL etc. Some games will just crash, in that case change you cpu type to host and enable Intel VMX or AMD SVM! Some games will really suffer from limited ram performance. I could hardly get 40fps on cyberpunk on my 3090 (normally it would get around 60-70). Also enabling pci passthrough will disable memory balooning. Which makes the virtual machines use the full amount of memory they have. So if you have headless gpus, I HIGHLY recommend using gpu-p on Hyper-V. This allows you to use memory balooning system of Hyper-V. However with this method, you can run multiple cryptocurrency mining OSes on each gpu flawlessly. I highly recommend proxmox for that particular use case.

[@CodingTheSystem]

No way. I was just wondering about this earlier today. Look at Twitter, I tagged you in a tweet about this earlier 😂

[@avidmedia2880]

0:12 What a beautiful cat❤

[@johnrussell6971]

I came here to learn about GPU passthrough but I'm just staring at the cat.

[@jfarre20]

You can skip the usbmmidd step on NV cards by adding the registry binary key DevicesConnected to 01 00 02 00 under Computer\HKEY_LOCAL_MACHINE\SYSTEM\CurrentControlSet\Control\Video\{some number}\0000. Upon reboot you can enable a fake VGA output. Works on my grid K2 also with some gpo tweaks you can use RDP shadowing instead of vnc

[@CraftComputing]

Iiiinteresting... I'll have to give that a shot. That might open up some more resolution options as well. Thanks for the tip!

[@jfarre20]

@@CraftComputing Just updated my display driver from 392 to 465 and this registry trick stopped working :( - but on the plus side I have nvenc/nvdec now and those work headless.

[@jaredhemley9175]

@@jfarre20 what grid driver did you use all the ones i tried had trouble with incompatibility in new games

[@jfarre20]

@@jaredhemley9175 I primarily use it for video decoding in EMBY. I'm not sure if games work very well on this old card. I've used drivers 392 and 465

[@jaredhemley9175]

@@jfarre20 where did you find those drivers the newest I could find on advanced driver search for win 10 64bit is 367 (370.41)

[@slickjim861]

I’m so irritated I didn’t find this channel sooner been trying to do this kind of stuff and looking for tutorials for so long and now I have them thnx

[@TheExcelon87]

Love it! Next phase, seeing how lean can you go on the client device. Thin client? Zero client? RPi?? Probably just minimum or recommended system requirements for Parsec I would think...

[@charleswofford5515]

I have an Nvidia tesla M40 in my machine. With a 980ti heatsink and fans on it for cooling. A little modding was needed but works great! the Pcb's are almost identical.

[@jerwal83]

Thank you Jeff, Great video as always

[@RamkrishanYT]

I'll guess it's leveraging Looking Glass? Edit: it was not

[@brianbuckleygray994]

Spacedesk looks to be the answer to the problems getting an output from my Tesla m40 on my guests. Parsec worked fine on the host OS as described here but couldn’t grab the screen on the VMs. My windows 10 hyper-v box sits on proxmox so I have nested virtualisation happening too, this isn’t wholly crazy as I think it’s the most effective way to have two graphics cards working with paravirtualisation. Now I have an excuse to buy a thread ripper and less guilt towards the imaginary funds set aside for three computers for the children. Thanks for setting me on this path Jeff!

[@sjoervanderploeg4340]

Or you could use the iGPU with LookingGlass for a dualheaded machine, no need to do anything remotely off another machine just use your desktop machine :)

[@santiblocks]

Was considering this scenario, indeed seems like a great usecase

[@MrMeek79]

This is pretty cool. Looks pretty good for running remotely on a VM, on a Proxmox server

[@IgorGiganskiANtiatom]

Awesome method! The way to survive scalperpocalypse!

[@jacobnollette7616]

Pro-tip - just use a virtual display in parsec, to run at any size. no registry keys needed

[@madkvideo]

This is a great option for people who can´t buy any GPUs at the moment

[@getyerspn]

I do wonder if the old arctic cooling kit for the GTX690 would fit the K80...it was made with two discrete coolers for each gpu chip and used stick on ram sinks.

[@ejbully]

Fyi... Depending on which pve you're using or if you're using grub or systemd boot... zfs on root may also affect... But instead of /etc/default/grub You may have to edit /etc/kernel/cmdline And instead of update-grub You may have to issue proxmox-boot-tool refresh OR pve-efiboot-tool refresh Depends on the version of pve - Depends if grub or systemd was the BL - Depends if using UEFI Unsure which is affecting the process - however if your wondering why your passthrough is not working follow what Jeff is doing - if it didn't work - try the other variations - one will work.

[@MCHEROBRINEBROS]

So I just followed this tutorial(though I'm using manjaro and a tesla m40) and IT WORKS! One issue, just like you, is cooling I have a 3d printed adapter for a server fan and at 12V it's deafeningly loud 5V is just fine for minor games but it just isn't enough for most the games I'm trying to play. So, my plan is to modify a dead RX 480 blower that is much quieter even at 12V and I would be able to run the fan on a motherboard header instead. Hope this works!

[@Sard_Onyx]

The madman did it!

[@Whatupdays]

Parsec is amazing I use it for my Windows and Bigsur vm's on my Unraid server. Great video btw

[@cedricvillani8502]

Bigsur VM’s? On Unraid

[@cedricvillani8502]

Oh Parsec released support for MacOS fairly recently it seems, crazy. Thnx for the heads up

[@pcmv6832]

And here I am in Unraid happy I don't have to jump through so many hoops to do the same thing lol

[@MrGameQ11]

May try this for gaming lounge

[@larryreppert6583]

Thank you, I was able to get more performance from my K10 converted to Grid K2. I also got the K80 working and it's not great but not Bad.

[@bendito999]

This guide is not only useful with Proxmox on a server passing a Tesla M40 to Windows VM (which your information here helped me set up, works fine), I also dualboot to just Windows 10 on the baremetal Poweredge R720 server for testing, and your setup with Parsec and the virtual display driver (I used usbmmidd_v2 instead of V1), is also useful there! For example, on bare-metal Windows 10, if I use Parsec to just watch the 'hardware' Matrox built in graphics on the server, at 1080p (with the registry adjusted to unlock 1080p on that ancient Matrox built in card), I get 30ms encode in Parsec (not great) But if I use Parsec to instead watch the virtual fake display like you have setup here, the encode actually kicks in on the Tesla GPU and the Encode latency time is down to 1-3ms or so (10x better). Basically tl;dr your guide here is helpful not just for Proxmox but also even for just running bare metal Windows 10 on one of these headless servers and trying to get good latency in Cyperpunk 2077 remotely using a Tesla M40.

[@fibbs01]

This video has answered so many questions thank you.

[@altonb]

I think you should try cooling the Tesla cards, at least the single gpu cards with one of the Arctic GPU coolers or an Kraken G12 AIO setup.

[@nesyboi9421]

He has in a previous video slapped a giant blower fan on one side

[@brianmccullough4578]

Oh hood,I thought this was gonna be hard.....

[@Destructor8031]

All you need is the virtual display driver. This will make it think there is a display connected to the GPU. That is all you need to to get Steam streaming to work.

[@win7best]

Incorrect. If your gpu isn't configured correctly you will get less then 1fps in your games

[@squirrel_ca9745]

Hi, could this work with ESXI 7 or will you still be limited by being forced to use Nvidia Grid to allocate the 2 GPUs on the K80?

[@btarg1]

This is a good idea for those mining GPUs without any outputs

[@CraftComputing]

At least nVidia mining GPUs have NVENC disabled in their firmware, making streaming difficult. AMD mining cards would be great contenders for this though.

[@gizmobuddy805]

Hey! I know that brewery. My wife used to live across the street.

[@ZMacZ]

0:22 Cat:"I hate being ignored when set to max floof."

[@ZMacZ]

Nope you can't reason with a cat for not cuddling. Food => Gather. Homeless => Long fur Warmth => Long fur, arguable. No cuddles => No excuse No treats => Umm, convinced, lol. (but still annoyed.)

[@ZMacZ]

Yes I read cats like books. I also greet animals more than their owners.

[@MikeWillTech]

I bought some Tesla M40's a long time ago and stuck them in my Dell R720XD's and have been trying to get them to work like this for quite some time! Jeff you rock! P.s. I use Hyper-V and this process works great with DDA

[@brianbuckleygray994]

I’m having trouble getting this to work with hyper-v using paravirtulisation on windows 10 21H1. Any experience getting this working or might I be better downgrading and going with DDA?

[@MikeWillTech]

@@brianbuckleygray994 I'm using windows server, so I don't have GPU-P yet. If you can deal with only having 1 VM being able to use the GPU, use DDA

[@brianbuckleygray994]

@@MikeWillTech thanks for that, if all else fails I can dedicate a card per VM, it’s more the number of computers I want to get under control.

[@zeeweenor]

Wow this is cool maybe one of my future hobby project

[@HocExcelOnline]

Could this work with a Tesla P4? Thank you

[@sevenredundent7256]

I love the idea of never telling your kids about where the performance comes from, letting them figure out that their computers suck, and should get a job to buy a better one.

[@johnroz]

Thank you for making this video. I hope to use steam and a steam link device. Wish me luck!

[@zsomborherceg493]

OHHH This need more IT knowledge that i thought :D

[@peterhindes56]

could you do one native and have the other running in hyperv like the other video?

[@CraftComputing]

Yes, that should work just fine.

[@TheGonzooooo]

Thank you so much for this amazing guide!!

[@kalross73]

Excellent find. Thank you.

[@experiment18a40]

just to make you aware jeff it works with any gpu not just headless, i followed your guide but i was using a gtx 970 and it works exactly the same.

[@zero_day_virus]

Great stuff. By the way, I use your glass of beer as the progress bar :)

[@ZMacZ]

What is the longest single sentence, involving computers/software, you can make using mostly abbreviations ? (contest) (it should be spoken as a single sentence, not seperate sentences stringed together.) (the primary score is for the amount of abbreviations.)

[@graybandit1140]

as someone looking to upgrade the kiddo setups from ancient Dell boxes, could you recommend a decent ebay server box to get started with one of these? appreciate all the content and guides! this is becoming my favorite channel after LTT :-D

[@CraftComputing]

After LTT? Pft.... 😉 Dell R720s include PCIe power most of the time, and make great 2U servers with airflow to support these cards.

[@ikkuranus]

@@CraftComputing He meant favorite after BmB

[@graybandit1140]

@@CraftComputing thanks for the rec! i'll have to tweet you the current setup while I gameplan the upgrade with your videos

[@cedricvillani8502]

LTT is a clown child that knows almost nothing, his entire corp is affiliate links and shills. Kids watch LTT

[@loksolidsnake]

I've tried Parsec and didn't like it and wouldn't give me the performance I wanted, tried Moonlight instead and only requirement for the VM would be to install Geforce Experience and setup the Shield section to add games. Got Moonlight installed on my X900H 65" and added a logitech wireless gamepad to the tv and now I don't even need a Rpi to run a software like parsec. You should look into this also, you can also multiple machines like Parsec does.

[@Processador_DE_BaixaQualidade]

sunshine moonlight obliterates parsec

[@Punchmememe]

This methode works to for an rtx 2060 👌🏼 thanks man 😁

[@grantmurdock7385]

I have to try this now.

[@Nik.leonard]

I use usbmmidd to run parsec in a optimus, no mux switch laptop with the lid closed, so when you said that there was a solution, I bet that usbmmidd was involved.

[@raycert07]

16:22 parsec only supports the raspberry pi 3, not anything else. Since they have to access the encoder directly instead of through an api, it's much more work to develop an app for all rpi devices

[@brettwebb6789]

I'm trying this with a Tesla P4 but I can't switch from TCC to WDDM with the Quadro drivers. Is it possible to do this with a P4 without the GRiD license?

[@OTechnology]

I tried partitioning a Titan X Pascal inside a Windows VM using Hyper V for nested virtualization but it performed so bad its unusable. I'm guessing nested virtualization cause a lot of io wait and therefore laggyness. Was testing on an i7 5820K + Asus X99 Deluxe U3.1.

[@felikssmauritis8428]

Amazing video!!! There actualy is a waterblock for the tesla k80 on aliexpress.

[@CraftComputing]

Yep, because it shares the same PCB as the Titan Z card :-)

[@gamertcell8425]

Gosh! I shouldve done this before!

[@Nimitz_oceo]

Hi Jeff. I have a Tesla k80 with 24GB of ddr5 ram. And I’m running esxi. Do you think I might be able to replicate your setup with this GPU. I want to use it for some data science and ml training and of course gaming. But gaming is a must

[@GaryBlydenburgh]

Tried this with a Tesla P4 but I can't switch from TCC to WDDM. Does this only work with older cards?

[@geekinthegarden3927]

I have a Tesla M40 that I couldn't figure out how to get to work so anything on getting it functional would be great

[@spaingerusmacos9894]

I would like to see a update of this with a m40.

[@Romnipotent]

Time for a easy guide revisit now with the script and higher optics on paravirtualisation?

[@brycedavey1252]

I have a problem when watching this video, I'm more interested in watching the cat 🐈 :)

[@BF26595]

I think I'm going to steal this idea for a virtualized design infrastructure on vmware. CAD should run fine if GTA V can do what I saw in your video :-) I have a dl380g8 in which I can slot a couple of these cards and have 4 vms fully accelerated

[@CraftComputing]

That should absolutely work. Plus with 12GB of VRAM each, you'll be loaded for bear when it comes to CAD. Good luck!

[@jstechsector3925]

Great Video, today i ordert a Nvidia K80 for my Dell PowerEdge R730. Hopefully the graphics card will run as well as your solution under VMWare ESXI 7

[@brettpeckinpaugh]

I do some of this in bare linux but with a consumer card. That way I don't lose any performance. Just use a desktop KVM and switch monitor ports.

[@rebelwithoutaclue4440]

why not remove the shroud and strap fans directly to the heatsink? or is the heatsink part of the shroud on these/ not dense enough for regular fans. I have 2 120mm fans on an rx480 and it runs cool and quiet. I realise these are higher thermal output (and they look pretty with the shrouds) but is this not an option?

[@annieworroll4373]

Exactly the video I need, I'm looking for a GPU to use with VMs. Need Windows for college, and there's a course with OpenGL, that should go much better with my VM able to use a whole GPU. I don't have a huge amount of PSU capacity headroom, though while it's idle(which it would be when I'm not hammering it in my VM, and I'll mostly be not be hammering my main GPU at the same time) it should be OK. Being able to use enterprise cards might open up options, though I'm currently leaning to an RX6400 for cost reasons.

[@andrewcroberts1]

Hmm, I see you cut out the part that got Franklin to the hospital....... 😂😂

[@CraftComputing]

Shhhh, you see nothing.....

[@mgv1429]

Oué mec tout marche comme presenté je te kiff

[@WisdomShortvids]

fooking life saver mate

[@chriscambridge5737]

I wonder if you can comment on the following question? If I run headless GPUs inside a GPU server (Gigabyte) to do Compute (BOINC/F@H), and I then access Ubuntu desktop via IPMI (iKVM) will it work? There are some reports that you just get a blank screen as the BMC display cannot output if dedicated GPUs are installed; although these are mainly about Supermicro servers. I have searched Google high and low but cannot seem to find a definite answer on this. Your opinion on this would be most helpful.

[@stephenp4440]

How are people handling Windows licenses inside of proxmox for 2 machines on a Kepler?

[@revkergen1618]

Buy a cheap key from eBay or do what I do and don't use a key at all.

[@AkselEstensen]

Host a licensing server

[@CraftComputing]

@aksel Shhhh..... Not so loud.

[@akiro43]

for some reason my virtual machine gets stuck on boot. It shows the Proxmoxs UEFI loading screen and the bar runs through and then it goes on to a black screen and then nothing. Pls help

[@2011jaydog]

pretty neat jow u gpot it all working

[@itsdeonlol]

Thanks Jeff!!!!

[@corbinxtitus]

Hopefully I can get a response, I've done everything in the tutorial, but I'm still met with a black screen in parsec. Remoting in with RDP or VNC shows encoding activity for the gpu when I attempt to connect with parsec, but still black display. Generic PNP monitor is selected, and I've disabled the VGA display from ESXi

[@antoninoromeo4015]

Hi great video !!!! in your opinion tesla M40 to be used with proxmox windows vm does need Above4G decode enabled?? my mainboard don'have this feature. Many thanks!

[@GustavoOssandon-t4p]

have you tried NVIDIA A16 gpu card ???? it has four A2 inside

[@PhilippHaussleiter]

Thx. For the update. This is really an interesting setup, Can you elaborate the network issues with Linux VMs? I have an ubuntu vm running on proxmox with PCIs passthrough without any problems? (Or I just don't see them)