GPU Pass-Through - VFIO - Let's run all the GPUs together!

VFIO Call to Arms and GIVEAWAY Link:
forum.level1te...
Linux Kernel VFIO docs.kernel.or...
Related Main Channel Vid:
• VFIO is Back! Back AGA...
*********************************
Check us out online at the following places!
bio.link/level...
IMPORTANT Any email lacking “level1techs.com” should be ignored and immediately reported to [e-mail].
-------------------------------------------------------------------------------------------------------------
Intro and Outro Music: "Earth Bound" by Slynk
Edited by Autumn

[@Level1Linux]

We're doing a VFIO PC giveaway!! Main Channel Video Here +kzbin.info/www/bejne/gXLdiKB3aZVki5o Enter on the forum! + forum.level1techs.com/t/vfio-passthrough-in-2023-call-to-arms/199671

[@BBWahoo]

Should've beaten linus with a shovel at LTX when you had the chance

[@marcogenovesi8570]

At the present day, the biggest threat to VFIO is the lack of affordable boards and hardware with multiple PCIe slots. Heck even a full-atx board with two whole x16 slots is expensive

[@CMDRSweeper]

The reason my storage machines are built on old platforms these days... I need as many PCI-E lanes as possible for storage controllers.

[@donoteatmikezila]

Not to mention the pitfall of many, many board having multiple x16 slots, but only the top slot is actually x16 and the rest are x4.

[@Fractal_32]

Buy used or old hardware for cheaper than the new hardware. (Old EPYC or Threadripper chips would be great for a workstation, if you do buy EPYC chips make sure to know what board they came from since they have Efuses for being locked into a motherboard venders board.)

[@Mpdarkguy]

@@donoteatmikezilaor the second slot is way too close and you would be sandwiching the gpu fans to whatever is the second card you’re attaching

[@AthanImmortal]

@@donoteatmikezila Or a 16x slot that's 4x, except if you put anything in the adjoining 1x then it's 1x etc. A lot of the AM4 platforms had this to the point I wondered what the point of a full ATX was.

[@DangoNetwork]

would like to see intel flex with SR-IOV setup. (waiting for price to drop)

[@MS-uo1mu]

I feel VFIO might be good for my use case. I had a baby a few months ago, so it could he good because I can overspend on a single GPU and share it with the family (currently the only one who games) as opposed to just giving my [very] old desktop. I also like the security angle as it annoys me how much things bleed; it is why I'm here as Windows is becoming ridiculous. I'm really keen to start a home lab with my next PC upgrade...but aforementioned baby is leaving the 3060 Ti still gather dust. So it may help for that as I don't have a graveyard of hardware.

[@UltralifeTech]

Inspired by another KZbinrs “x gamers 1 cpu” projects, I’ve been trying to emulate this multiple times. Usually on old hardware, lately my effort has been with a 3900x/1070ti. Although I’ve had issues with some kind of vBIOS reset bug. I use XCP-ng as my hypervisor. But I should really try KVM again.

[@alexandermendez9013]

U can say his name lol

[@bosstowndynamics5488]

I don't have direct personal experience with it but from what I've seen around the web Proxmox is the go to hypervisor for VFIO - certainly most of the people I've seen describing their setups use Proxmox, it seems to have among the largest communities for home lab dedicated hypervisors, and it's quite stable. Plus, it supports single GPU VFIO (by disconnecting the GPU from the host, still one OS per GPU), while other options require a host GPU even if you aren't using a direct video out from the host.

[@T19R0N]

LEVEL ONE LINUX!!!

[@applicablerobot]

Lol, I was just going to post this. Always a good day when a new L1L video is released

[@Stephen-yk5ik]

VFIO is such a great concept it really is a shame there really isnt more enthusiast level support from manufacturers. Especially with the rise of virtualization and its permeation into the enthusiast and regular office space. Hell I know smaller companies who are running all of their systems in virtualized environments with docker and kubernetes

[@seantraynor]

Love to know more about the A770 SR-IOV! Sounds like a cross flash to the Flex 170 BIOS.

[@NPzed]

I would love to see the day where I can full time a baremetal hypervisor and/or Linux system and still be able to run the Windows only apps like Adobe for my photography workflow, some games, and other workflows as discovered. I hope VFIO can allow that functionality at some point! Thanks for the awesome video and pursuing this awesome tech!

[@sheldonkupa9120]

So awesome he tries to restart the hype! Make vfio great again, well done Wendell👍👏🍾

[@jeziel675]

Really appreciate the work you put into fostering the community behind VFIO and virtualization and passthrough. You exemplify what great open-source can do.

[@gudenau]

I really want SP-IOV support on consumer GPUs, there are some really janky stuff that could be cool that would only work under that.

[@tylerbarr2740]

This has to be the future Im keeping my on the open-iov project from archcompute

[@LeminskiTankscor]

I did on my old machine for Windows 10, so I could easily play in VR. I've since abandoned Windows entirely, but I'm still interested in VFIO, especially if I go home lab gaming machine later. P.S. Love that you are covering this

[@no.no.4680]

Has VR on Linux improved?

[@FakeMichau]

So you are running VR under Linux? How does it work?

[@LeminskiTankscor]

@@FakeMichau I'm using ALVR on my Quest 1. Takes a bit of work, and I'm not going to pretend it's easier, but it's a wireless solution that let's me skip Windows entirely and play H3VR quite well.

[@OmegaMadMaxFusion]

Some things happened. I can't fault Wendell for not having time for this. I'm glad he's able to work on this more now. I've had limited success with VFIO on my rig and I also want support and enthusiasm for it to grow.

[@9768236]

Wrote my story on the forum. Thanks for bringing VFIO back up again to the masses, Wendell. Here's to hoping AMD can start troubleshooting the reset bug and all of the vendors embracing SR-IOV.

[@the_beefy1986]

I currently run 2 previous gen GPUs in my system (one for Linux and the other for a Windows VM). I might consider shelling out more for a single current gen GPU if I could use it under both OSes simultaneously.

[@bartios]

Thanks for all the work you're doing on VFIO Wendell!

[@danksagrabowski2438]

I'm personally using VFIO! Running Arch Linux as a host with an Intel A380 GPU and an RTX 4070 for my Windows guest to play games via Looking Glass. I've been using this setup (apart from some GPU upgrades) since about 2 and a half years now. Thoroughly enjoying it!

[@solidreactor]

My dream is to move to Linux and still be able to use some of my Windows only applications (and games). One of these applications for the moment is ROCm and PyTorch support that is in Linux only. About the composable infrastructure, hardware "as a software service" that do indeed look very very interesting and would like to take that as the next step after VFIO.

[@angiebueno9303]

At last your back on this channel!🎉 Despite the daily show I was entering in depression... And I was eagerly waiting for deeper vfio content. Thank you.

[@PakoSt]

SR-IOV support by Intel consumer GPUs - this makes the Intel offerings veeery tempting despite early adopter/ 1st gen hardware/ mod requirements/ lower performance worries. Is the same mod available for A750?

[@sheldonkupa9120]

Good to see gpu passthrough a topic again👏👍 I do a lot of gpu passthrough (for science😉), also single gpu passthrough, also with igpus. I use proxmox, and honestly the most issues i have is that with new kernels and upgrades things have changed without good documentation. Just to mention amd agesa breaking everything😣 When passthrough breaks that means a lot of google fu. I wish mediated device passthrough would be cheap and available at consumer level😪

[@MisterOutofTime]

Hope we gettkng better vgpu /sr-iov suppoet on desktop gpus in future,the experience of using vgpu unlocker/patcher for the 2080ti on nixos was atleast really painless and fun to use, love the concept very much, would use a lot more if i could upgrade my gpu to a top spec amd /nvidia and have these features ...

[@hydroponicgard]

I'm glad to see VFIO being covered. It'll be fun to see what I can do when I get FW16 w/ 7700S and external GPU... What kind of madness can I pull off, is the question >:D

[@brandonphilander661]

Can't wait for bhyve to mature and have hardware accelerated GPU passthrough on FreeBSD.

[@gustersongusterson4120]

If intel could do something very un-intel virtualizing ARC could be big for them.

[@Fractal_32]

VFIO has been fun when I used it. The only reason I don’t currently use it is because the games I want to run get angry over running in a virtual machine. Thank you so much for all the hard work that went into making VFIO.

[@andre-le-bone-aparte]

Not Just Games.... Using multiple macOS Xcode Versions to support development on older iOS hardware, and having multiple GPUs for each guest OS is pretty cool for software developers!

[@MaroltG]

Yes yes vfio is my baby. I use it on my proxmox host, passing gpu to windows and osx using rtx 6600xt. I also have most of my applications virtualized. It is like having multiple computers, but you just have one beefy workstation instead. 👍

[@sheldonkupa9120]

Wait, is 6600xt working with OSX?? I am stuck with rx570. And yes, proxmox ist the most awesome OS to passthrough, so cool!

[@iamnotyourmate]

I use it each and every day i have an rx 570 for guest and gt 710 to host

[@EnvAdam]

i use linux as a main OS but not all software works well under wine or i dont feel like faffing with it so being able to attatch a GPU to a VM and boot it up with proper acceleration in lets say fusion360 is great.

[@kortaffel]

What bothers me the most in recent years is a lack of PCIe lanes and slots on the motherboard. I have one slot for a graphics card and on x1 or x4 at the bottom. That's not enough if you have - Capture card - Sound card - Tv Tuner - Modem for your asterix pbx - 10 gig network card And actually use your PC for more than just a facebook machine

[@bosstowndynamics5488]

In a pinch, capture card, sound card and TV tuner can all easily be USB. Not sure about the PBX hardware but there's probably options there as well. Plus, there's more M.2 slots on modern systems and each of those is effectively a weird looking x4 PCIe slot with the right adaptor - pick the right motherboard these days and while it's more of a pain with all the adaptors you can actually get more medium speed PCIe slots than older consumer systems, so long as you only need one slot with more than x8 lanes.

[@xValkyrie93]

Just started my Linux journey 2 days ago. Dual booting literally worked for 1 boot.... Now Im stuck with Linux. I cant even open the bios. So Im trying to solve my issues with some Virtual Machines, Apple, Windows etc to solve some of my issues with certain applications. I was up until midnight trying to work out why the Virtual Machine was so slow. Found out that you need something called IOMMU to enable GPU passthrough. And then this video magically appears the next morning in my youtube feed. I have seen some L1 Linux videos before. However this one I hadnt seen. Very aptly timed though.

[@Netist_]

VFIO is great, but like some other people have mentioned in the comments, the biggest hurdle for me isn't even software necessarily (though I also desperately wish consumer- or hobbyist-grade SR-IOV was a thing), the problem is motherboards and cases. Getting a mobo with full lanes on multiple slots can be hard. Getting a mobo that can actually fit 2 full-size current-generation GPUs is also hard. Getting that to fit in a case is *also* hard. Ever since SLI went out of a fashion, it seems like this is a configuration that no one is really interested in supporting.

[@r0bo11]

Probably why the older generation boards like the X99's and earlier gen GPU's that aren't too power intensive are more popular, which can better support older architectures is why VFIO will always be on the enthusiast/hobbyist level. The hardest pill to swallow is the pricing of trying to configure a VFIO scenario that is more than just a hobbyist solution and most times bare metal is good enough for 99% of peoples needs. Interestingly Intel moving away from NUCs suggests that even the small PC market isn't doing well because of the lack of GPU oomph that most desire for gaming and higher processing tasks. But you're 100% right when it comes to the motherboard, then GPU and then PC case to fit all this technology into can lead to cost blow outs, not to mention how electricity prices have skyrocketed in most parts of the world. It becomes more of a nice-to-do instead of a must-have for many people.

[@jonathanisom]

I think the future will be programs like web browsers,etc that run in mini-VMs that are isolated from the rest of the OS, but looks like they are running natively on the host for most consumers automatically.

[@toumpanis]

I will build a system to replace my current one, I like my current one (Ryzen 9 5900x and RTX 3080 ti) but I want a system with igpu, again I lean towards AMD rather than intel. My goal will be to have unraid as main OS and windows as a VM with GPU passthrough, maybe even my NVMe passthrough as well. I like unraid but it has been pain to passthrough GPUs so far. I didn't try it in mine but we got a new unraid key recently for a friend and when we passed through the gtx 1050 ti that he has, there was no video signal output from the GPU and removing the GPU from VM rendered the VM useless, it couldn't power on any more even in VNC, that's why I am not risking it with my current pc. I will build a new one, that will be without any software and start with unraid and having windows 11 and macos 13.5

[@eldizo_]

That A770 mod sounds nice, the things we could have but have no control over... Still just dualbooting, the only thing holding me back is getting a second GPU with similar performance cause I like doing stuff on both systems.

[@shephusted2714]

the new threadrippers look absolutely beastly - only 3 mos out but the price will be beastly also - at least amd is iterating like a machine still - overall the mkt should improve and this bodes well for them and possibly intel as well. amd may have a double whammy in store with great looking next gen ryzen desktop parts in early 24 - they dropped the ball with regards to gpu but nobody is perfect - notably inception mitigation drops mariadb perf down 50% - hopefully they will be able to sort this out some more - could be something to cover with L1linux content

[@AI-xi4jk]

I can’t wait for new Threadrippers. When are they coming?!

[@s0litaire2k]

These are the days i wish I had a AMD card other than Nvidia. (looking at my ARC 770 unsued in it's box...) Hopefully one day I'll be lucky enough to buy/get/win a system with a AMD GPU/CPU so can get learning and testing. :D

[@bosstowndynamics5488]

Why can't you use your a770? The mod Wendell was talking about was to access Intel's SR IOV, you only need that to use one GPU for multiple VMs at the same time.

[@AI-xi4jk]

I use vfio on Proxmox. Would be great if Proxmox would have support for GPU pass through in the UI. Have to edit grub and such but at least documentation is pretty clear. Unfortunately you have to pay for vGPU if you want to split the GPU.

[@DieMiinz]

I've been using VFIO to play games for around 2 years. Before that I would dual-boot Linux and Windows, but I never liked dual-booting because it would cause me to use Windows most of the time out of laziness. I started with a GTX 970 in the host and an RX 6700 XT in the guest, then moved the 6700 to the host with an RTX 3080 in the guest. I also pass a network adapter, an SSD, a Bluetooth controller, and a USB hub for my mouse/keyboard. Overall it has been a great experience, but I have run into a few popular games that do not work due to anti-cheat garbage. Some examples are Valorant and Phantasy Star Online. One game I actually care about that gave me trouble was Elden Ring (it worked normally for like 6 months and then a patch made it start complaining about VMs), but I managed to get past the error by tweaking some settings in virt-manager.

[@jcugnoni]

Love VFIO! I have it setup on my Linux workstation to run a Windows desktop in paralel (second screen). It is a now venerable dual Xeon E5-2670 128gb ram but still a solid and very stable platform. The Linux side is running mostly simulation software (CAE: Salome-Meca/Code-Aster, OpenFOAM) and scientific computing while the Windows VM runs Office and Solidworks (with pretty good HW acceleration via VFIO). I have a GTX 1060 6Gb for the Linux side and pass through a GTX 970 4Gb to the windows VM. The only challenge was that NVidia drivers in Windows were not initializing properly. There was a fix; but I heard that now it works out of the box. Anyway, I really encourage everyone with a good knowledge of Linux to do that to run Windows with great graphics performance.

[@TheFlatronify]

For us we use VFIO for years now with a Nvidia 2080 SUPER + AMD RX6900 XT on a AMD Ryzen 7 3800X to run two PCs in one for work + gaming. "Two gamers one CPU" works flawless for years now. This technology allows to much more efficiently use the hardware and abstract the hardware from the OS (Windows 11 / Fedora 39 / Proxmox PVE).

[@loliganz]

This is very interesting! I hope that vfio comes to AMD GPUs in a way that you can have many virtual machines all sharing the same GPU and memory

[@BrotherGabe777]

If I run 3 separate gpus on my h11ssl-1 / epyc 7551p should I use crossfire or run them separately? XFX Radeon RX 580 GTS XXX Edition 1386MHz OC+, 8GB to be exact.

[@ddangelobr]

Building my system with kind of same specs as yours, Asus x670Creator + 7950x + 64GB DDR5 6kMTs + Two AMD rx5700xt for the vms, will upgrade vga in the future, proxmox route 🤞🏻🤞🏻

[@PascalWiemers]

I would love to run photoshop from Linux. I do 3d rendering and simulation with Houdini and redshift with nuke for compositing and davinci resolve for color and editing mostly. The only program that has no good alternative on Linux is photoshop. Gimp is not a good replacement and sometimes i need to be able to deliver psd files. So this would be perfect for my usecase

[@JeffreyGordon]

I use VFIO for my kids to play Roblox and a few other "difficult to run under linux" games under Windows... plus I have the Serif Affinity suite installed there which is garbage on Wine. Main GPU is 6700xt, Windows GPU is and older 570, but good enough for their games.

[@TeamLinux01]

I would love to build a gaming PC that I could run two SteamOS/ChimeraOS/Nobara/Bazzite OSes for me and my wife to game on. My current gaming PC is an i7 4790 and AMD RX 580. I haven't had much luck with PCI pass through testing with that machine.

[@zekicay]

I use VFIO to virtualize a router VM - pass through the LAN cards to it, then another for a NAS - pass through the SATA controllers and NVME drives, and another for HTPC - pass through input and iGPU. I would like to have SR-IOV but consumer cards don't support it - it's a shame.

[@MrTubeuser12]

I've been using VFIO for a few years and seems to be working OK, my system is a bit old though. ( supermicro w/s board-X8DAH+-F, dual 6 core xeons-X5690's, 48 GB ram, couple of old AMD GPU's + onboard video and a SAS controller running SAS 3 HDD's for the vm's + a SATA ssd for the Linux host ) it's getting a bit long in the tooth but chugs along, it's a shame more consumer grade hardware doesn't make this more affordable.

[@chadmckean9026]

I do use VFIO, that said i would probably use it more if i should access the hardware from both the host and the guest at the same time. I have a old dual port PICe x4 gigabit Intel NIC (82571EB) passed to my pfsense VM (the forbidden router) AMD Ryzen 3 2200GE / MSI B450M Gaming Plus (BIOS: 7B87v16)

[@lebenitza5778]

Let's be real here for a second: AMD GPUs are not for VFIO. I bit the bullet one last time trying to give AMD a chance here, they simply do not care about properly implementing FLR. There have been pleads from the community for years now in order to do it (see the one from the creator of Looking Glass for example). Unless you know whare you are getting into, do not buy an AMD GPU for VFIO. I still like AMD for what they are doing: CPUs, GPUs and the better Linux support they have. Not a fanboy of either side, being it blue, red or green; this is just a piece of advice from someone that tried plenty of AMD GPUs with VFIO.

[@alistairblaire6001]

Last time I got this to work was on Intel 4th gen with Z97. It was easy, seamless, plug and play. Since then I've tried on AMD X470 and X570, with and without ACS patch...it just refuses to work. AMD please support this on consumer hardware. You have 16 cores on consumer CPUs so the platform is prime for this use case.

[@Gastell0]

I have a server with EPYC 7551, Instinct Mi25 and Radeon Pro Duo Polaris, so not sure that'll be of any help, I was able to use HoloISO (SteamOS 3) to play games, though performance was quite bad, probably due to VM CPU settings

[@BoostChicken]

Also, your call that GPU virtualization is the future of computing is bogus. It's the present of computing with AI workloads. AWS, Azure, GCP all handle this just fine.Also with containers/cgroups2 your "holy grail" system is very real right now.

[@NathanielStickley]

We're having difficulty finding qualified candidates for a systems engineering position for NASA-funded projects at Caltech.... is there a section on your website for job ads?

[@kkrolik2106]

I pass trough output from my $150 RX 6700 mining edition GPRO X080 via iGPU through my mainboard HDMI to get image on Display only require few lines in registry :)

[@shanent5793]

I could never get the economics of this to work. For the price of a 24-core TRP system I could get three client systems with 7950 X/X3Ds or i9s, each with better single thread performance. All the storage is on a SAN, so two GPUs and an HBA won't fit on any client motherboards. Passsthrough seems to break the virtualization abstraction, how can a VM be moved to different system that may have an incompatible GPU? How do Windows, Xorg or Wayland respond to having the GPU change from AMD to Nvidia or vice versa? Even with identical systems how is the GPU state and VRAM synchronized?

[@CoryMT]

Honestly, I had an interest in VFIO and looking glass, but I've since started running a home server. All I really want is sharing ONE GPU with ALL VMs. VFIO would be great (however my understanding is that 1 GPU would only work with 1 VM), but I'm not giving any company my money for hacks and workarounds. I'm tired of the half promise and then act like it wasn't said, proprietary SRIOV alternatives, or secret hyper-scalar only driver BS.

[@johnpaulsen1849]

I love your work. My unRAID is running dual GPU and USB controller passthrough. My son uses one of these vms daily. Also, uses zfs and deduplication. Games are large and having two copies taking up disk space sucks. Any hope of this working like the windows hyperV paravirtualization in the near future?

[@ciscocomputertech]

Back when the mining boom was all the rage I managed to scoop up 3070 2 x 6600xt 2070 super and a 1660 I wanted to VFIO my machine that had the 2 6600xts and the 1660 so that I was passing through the 6600xts to a mining vm and the 1660. And I would run everything on a Intel integrated GPU for my actual machines. It never happened due to complexity of project. Would LOVE to test stuff like this now

[@MrHakisak]

I have been trying to setup windows vm's in TrueNAS. I have set all VFIO drivers. But there is a problem where I have them all share the same 10g NIC on a bridge, but when I iperf with the vm's it will destroy my Epyc 7F32 and speeds are only 5Gb/s. iperf'ing truenas from another 10g computer works fine. its only when im tring to iperf a VM.

[@donoteatmikezila]

I enjoy VFIO and feel like it's a great solution...so long as you don't play any games that rely on anti-cheat. There are lots of games that cannot run under VFIO. Tarkov, Siege, Star Rail, Genshin, VR Chat, Valorant, etc, etc. If you don't play online games you probably won't run into any trouble, but if you do, you'll hit headaches real quick. That said, when it does work, it's magic. Quick tip I have is to grab a cheap USB3 card which you can pass along to your gaming VM. No fuss with software passing of software USB devices and EZ sound solution via any USB headset. I haven't been able to get looking-glass working well no matter what combination of configuration I use. I pass a 3080 Ti to the guest and try to use an intel igpu for the host and the looking-class client is choppy and laggy. I get told that Intel iGPUs are no good for this, something about the ring0 bus being too slow. Ok. I instead use a Radeon Pro WX 2100, which performs just as poorly. I get told that's too slow. I use a Nvidia 1050 Ti, which works *marginally* better, but still not smooth at 1080p 60, with anything higher than 60fps or 1080p being unusable. I dunno what the issue was. It worked fine to do the little demo with it everyone always does where you have a directly connected monitor at a tiny look-glass window and you see they're in perfect sync, but when you actually blow up the looking-glass window to full size and try to play a game at 1440p 120fps the whole thing just falls over. It was much easier and more reliable to just use sunshine and moonlight and lean on the cards video encoders.

[@jorgeruiz7541]

Wendell, greetings from CHIAPAS México. I have a question, can I enter the giveaway even though I've never used VFIO in my life? Amber the thumbnail and editing on the main channel was awesome.

[@cooky842]

I used to do vfio vms with a 1080ti (host) and a 6800xt on Linuy main cpu, 5950x to have a gaming vm, à sécurité transactions vm, etc. Nowadays I run s 7900xtx and no vm because linuc gaming is too good! But I still use vfio and my lvl1 kvm on my proxmox server, to pass gpus to my plex vm and my gsming server vm. Would love to have a way to do single gpu vfio on my main rig tho...

[@bosstowndynamics5488]

Sadly I don't think SR IOV is happening any time soon for consumers for a few reasons: 1) Single application GPU demand is going up rapidly right now so that's isn't much need for advanced features other than just AI performance to sell GPUs 2) The hardware to do SR IOV for GPUs is as far as I'm aware quite complex 3) Few consumers are demanding it enough to drive development. Even most power users who are using VFIO are getting away with detaching the GPU from the host system or using multiple GPUs 4) There isn't really any software side push for this. The reason IOMMUs are ubiquitous now is because Microsoft made it mandatory for Windows certification so they can do memory protection with it, but I doubt they have much interest in the much harder push required to get GPU visualisation extensions given that the main effect that would have is making it easier to run not-Windows. Maybe when they start needing more direct GPU access for WSL they'll be more interested but for now I think we're stuck

[@JPEaglesandKatz]

think nvidia/amd rather sell more cards than ever truly going for VFIO for consumers....

[@waterflame321]

Run linux with window 10 in a vm. Pass through a gpu because I cant use the same one as the host. Split ram with hug psges. Separate HDD fully passed through. Secondary usb immou group passes through. Cpu split inhalf by core pairs. Works great. Wish I could use one beast gpu for both. Well it'd make multiple vgpu I'd imagine as using the same gpu space could be an issue. Anyway mostly use it for VR/Gaming. Works mostly on linux but anticheat. Or AI meaening in a split linux VM

[@mathyoooo2]

7:30 yes, I've been using VFIO for a couple years now! But recently I've upgraded from am4 to am5 and so far my experience regarding VFIO has been worse on the newer plattform...

[@stevejjd]

Im new to Linux and recently had the idea of running a PC with multiple GPUs that are passed through to various VMs. I need multiple specialised environments for VFX work. For example legacy and contemporary environments so I get the new and the old. Also need a VM per VFX company I freelance for as they all have different pipelines. Is there a forum or somewhere I can go to learn how to set up such a machine? I'm a freelance 3D artist and this setup would be core to my workflow. I'm willing to pay a technician to set it up for me. Thanks

[@r0bo11]

I've been holding onto hope from afar when it comes to things in the Open Source community for stuff like LibVFIO, VirGL and with GPU multiplexing or paravirtualisation. Right now the costs are prohibitive in the VFIO space even for things like wanting to have a segregated OS environment where you can have the rights to your 'own' PC that isn't controlled or tracked in some way. So far I think the future will be in the single GPU space where all the requirements can be para-virtualised into segregated VMs. Just buying 2 brand new GPU's with all their constraints in vBIOS or how they've been licensed and controlled is too prohibitive and too many obstacles for really democratising the use of them. If GPUs were truly free and open we'd be gaming on our preferred environments, but the walled gardens haven't opened up to the masses let alone the enthusiasts who have their own preferences.

[@antonhofmann1796]

I run a 6900xt and a 6400, the 6400 is enough for me to do all the necessary 3D stuff in my Windows VM while the 6900xt does the heavy lifting under linux, if needed i still boot into windows with the 6900xt for gaming.

[@josephhfry]

I was 100% going to build an epyc server and virtualize my gaming system with VFIO on it. Until I read about the issues with DRM and cheating detection in games being triggered by such a setup. Unless I have very high confidence there will be no issues, I fear I have to build two systems just so I can have a windows (cringe) gaming PC.

[@jim0_o]

Sorry to bother you: I think i should upgrade my external storage 4small + atleast 5large, I'v considered buyin a type of suitcase where i can attache them all inn there and connect them to usb and power in the middle while i hang dem on the wall of the suitcase,and running them all throuh a powered usb hub that only sends me the one usb++ cable. How f'ed of an idea is this ? i assume cooling would be an issue but winter is around the corner AFAIK. I would consider schuking them and put them into a case but looking at that it seems it would become expensive. I want them together configured in a automatic system for depuplication and backup with a SSD as the brains storage isthis pheazable.. i just want a system i can move around intakt PS : not rich, should I buy a solution? Or even a barebones amd5 system with rdna onboard, and md5. Ps2: has it become viable to run stuff like this over raspberry pi ie. have it serve 8 hdd with ~~ 60tb on 10 disks.. yeah ramblin but i hop you de de

[@accesser]

Am I the only crazy person who wants this in the lower power homelab market, I'm dreaming of being able to pass though a couple low to medium GPU's into VM's all inside something like the Asus/Intel NUC's.

[@owlmostdead9492]

If AMD gives me SR-IOV on a modern consumer GPU in which the display outs can be shared, I’ll never even look in the direction of nvidia ever again.

[@erk5243]

once upon a time i went down the windows GPU pass thru rabbit hole and spent weeks and weeks lost, trying everything i could find and nothing f@%#!$ worked. I thought this was impossible, I now know its because Nvidia hates me and I didnt know L1 was pushing this tech. this makes me happy!

[@kienanvella]

I do have VFIO running, but it's on a supermicro x10dri board that supports all the fancy features. I'd love to have a more efficient (more consumer-y) platform to do vfio on, but there's nothing in the consumer space with enough pcie lanes for my use case.

[@randomname3566]

I'd benefit from the vgpu feature, however I'm nto currently using vfio because lets be honest - who has the money to spend on a second gpu right now if I can just reboot for example... however in my next laptop where I hope to have thunderbolt it'd be awesome to just plug in that gpu and run windows on it just for games. As for my current laptop, well... like you're saying, sanboxing would be deifinetly of use, I was trying hard to stick with the intel vgpu of the integrated graphics, but that one felt quire rough... definetly far from what virtualization of the CPU is like. You know it's a bit of an egg and chicken problem, people arent using vgpu because its not available to the general public, and nobody cares because nobody uses it. When intel was entering the gpu market I had high hopes that they'd brign vgpu with them to the consumer market like they did with their integrated graphics a very long time ago. Such a missed opportunity for them.

[@wezzy1983]

I'm messing around with GPU partitioning, working really well

[@porklaser]

Love this whole plan. I have been using gpu passthrough in proxmox for while, running on old hp workstations turned in to server. The grail is true gpu paravirt where the whole software and hardware stack is on board with letting VMs use gpu resources. Fire up VM, gpu access shared with host no muss no fuss. Play elden ring in full screen or windows mode on a windows guest on your linux box while stable diffusion runs in another linux vm. To be frank Nvidia cards have been able to this, in hardware, since the 20xx series. They could snap their fingers and publish a driver update and release an sdk and we’d have what we want in under a month. Nvidia doesn’t care though because they are enjoying 1000x markup on gpus with these fun toys in the enterprise space. And charging a subscription fee to boot.

[@daveg4417]

I have been using VM's for well over a decade now, I use them to run older versions of Windows with software that I either wanted to sandbox or that only ran on that older OS. I also use VM's to keep my main Windows OS drive clean, instead of installing dozens of apps onto the OS drive, I will run a lot of my software in VM's. System upgrades and new OS's means that I simply have to copy the VM to the new computer. I haven't gotten into VFIO though, but it does sound useful.

[@Invictus_Mithra]

I've been interested in virtualization for a couple years now. I've started to dabble with it through things like Proxmox. I've wanted to try out a vfio based system so I can learn Linux while still being able to use Windows but I unfortunately haven't had the chance to try it yet. I'm going to be switching to SFF because I'll be moving around quite a bit in the coming years so I unfortunately don't know when I'll have the opportunity to give it a shot. But it's definitely very interesting!

[@OOJokerOO1991]

Wendell doing Lord's work :D The tech lord that is xD Anyways, thanks for your continued efforts!

[@benjaminoechsli1941]

"Wendell calls for aid!" "And the community will answer!" Let's do this. 😎

[@Oktokolo]

Wow, the media industry will so target this tech as soon as they realize that you can circumvent HDCP by using that "monitor" driver.

[@nazar-pc]

Used VFIO for a decade, but Looking Glass didn't work well when I tried it last time I tried it for 4k resolution

[@SeithonJetter]

I mean... the most obvious thing is that you will be able to have "fresh" tuned and dedicated virtual machine OS's for each and every game, in theory. So if you have a game that runs best on driver X and another that works well on driver Y, then you can just do that :)

[@cainzjussYT]

Many years ago i wanted to run daily linux and have windows as a VM just for gaming and some apps that are not native to linux. Back then i could not figure it out. Maybe it was because i just had 1 GPU and i wanted to share it between the host and the guest. Today as i still have the same dream but have far less time available to jump thru hoops. Installing a new OS and getting it set up the way i want it will take months on its own. The way i see it...bios settings aside. If there is no handcrafting needed to be done by the end user to get VFIO working (maybe a plugin install to virtualbox or some VM software). I'm sure even i would have a go with my limited time.

[@arkratos3727]

I used to use VFIO but then I had to reinstall my primary OS and haven't had time to set it back up because I feel like the steps to do it each time changes. I want to and honestly need to get it working again so I can do CAD work for my hobbies.

[@Redd_Nebula]

I dont use VFIO but I want to when its a viable option. I prefer linux but its impractical to use anything other than windows with what I play and dual booting just ends up with defaulting to windows for convenience

[@johanngambolputty5351]

I bought one of those small old cards just to try to do pass-through with, but ended up not bothering, seemed a lot easier to just avoid any non-wineable windows software altogether. As a curiosity, supposing a piece of software doesn't need to somehow access hardware more directly, suppose it just needs to talk to opengl, can you have a guest driver that just forwards calls to the host driver (and forwards back results)?

[@pilo11]

What about gpu-p for linux... This is a hyper v feature but i hate hyperv... I wish KVM will nake it possible in the future

[@WeedMIC]

I hope to take a dual xeon 48c/96t machine w 6 1050tis and have users at home connect w pi devices via ssh and run their vm from wherever the plug in. I think this is a big help.

[@z0mb1e564]

I love the idea of VFIO but honestly has seemed like too much work for me. But if there’s a clear path, I would definitely implement it.

[@evilsdexter5261]

What I don't get is why is AMD sponsoring this instead of just enabling sriov and then sponsor the real deal....

[@Gooberpatrol66]

You'd probably be interested in Spectrum OS (VM system like Qubes)

[@joshua_lee732]

Hmm Im curious about this as Ive never really considered doing anything like you mentioned before.

[@sarf9069]

been using unraid for this for about 2 years now. main vm is linux, games that dont work on linux i just boot windows but thankfully more and more games just work on linux now. would be nice to run windows and linux at the same time with both using the same gpu though.