4 Games on 1 GPU? SR-IOV & Virtual GPUs -- Why Consumers Need It

[@user-xh5pi2nf9q]

This is exactly where I think the future is going for home computing. Lightweight client computers with long battery life with a home server/heavy lifting box. This is exactly why I bought a big Caselabs case years ago so that I could work on making something like this but I'm still learning the programs/software as a hobby.

[@johnbuscher]

>I need *more* I didn't know Wendell was Tech Vergil. And every time I turn around, he's even more motivated.

[@aj35lightning]

Thanks for doing what you do man. It's reassuring to know the community has people like you helping push things. I know the industry is big and there's lots of people on different forums working together and I should extend my gratitude to everyone, but you consistently are able to present that information in a way that get's me excited about what the future holds.

[@MikaelKKarlsson]

Windows: - I do not share(graphics)! Wendell: - Hold my Earl Grey, careful it's hot!

[@SxC97]

The latest version of HyperV has native support for GPU-P using consumer GPUs for free!

[@desmondsamuel9548]

I dont mean to be offtopic but does any of you know a trick to get back into an instagram account..? I stupidly forgot the password. I love any assistance you can offer me.

[@charlescolby45]

@Desmond Samuel instablaster =)

[@desmondsamuel9548]

@Charles Colby thanks so much for your reply. I got to the site thru google and I'm waiting for the hacking stuff now. Seems to take a while so I will reply here later when my account password hopefully is recovered.

[@desmondsamuel9548]

@Charles Colby It did the trick and I now got access to my account again. I'm so happy! Thanks so much you saved my account!

[@loremipsum5697]

This is the type of content I suscribe for! You guys are the nerds nerd.

[@JarrodsTech]

I've wanted this to work well for ages so I can have a VM for Adobe Premiere with GPU acceleration and another for gaming 🤔

[@VictorEstrada]

You can do that on a single physical pc...

[@xDownSetx]

I would personally be interested in an SR-IOV networking video. I have the hardware, but have yet to delve into that aspect of it and currently pass the nic directly to my VM.

[@sherwing9054]

One of the only youtube video that is actually what people need.

[@jh-lp7cg]

Does looking glass mean I can now run windows in a virtual machine and play all my DX12 games etc and finally have linux as the host?

[@dannyeagle9688]

Yes

[@johnmitchell9705]

@IT Developer This is what I am doing, one monitor, switch between monitor inputs, two GPUs.

[@micher60]

John Mitchell Also, most people don't know that most monitors have an embedded into DisplayPort control port called DDC, so you can use a program like ddcutil to switch monitor inputs from software

[@cybercat1531]

@@micher60 DDC = Display Data Channel. It's actually been around for ages, CRT's from the 90's support it. On my modern HDMI & DP displays I can fully configure all settings I can change from the monitors menu + more that are not shown there.

[@liaminwales]

With a different OS on each display

[@RealYethal]

Hopefully QubesOS will implement this so we can have gpu acceleration in AppVMs without pci passthrough

[@joonasfi]

Oh, nice use case!!!

[@googIesux]

Aaaaand that was my first thought. You have some taste :P''

[@liaminwales]

we have tech KZbinrs and we have Level1Techs, boys and men. just amazing what crazy stuff happens when you start drinking Tea and working hard.

[@olealgoritme6774]

Loving your work. We need more attention to SR-IOV and vGPUs. Now the real question is... How fast can we hack our Vegas to get SR-IOV functionality? ;-) PS! Give us a heads up when you have gotten SR-IOV working on the MSI x399 platform. Running 2990wx + MSI's meg motherboard myself.

[@MegaManNeo]

I'm confuses by KZbin now, thought I already subscribed but YT was like "nope!". Good thing this video showed up in my recommendations, your Videos are just too interesting to miss out.

[@carbongrip2108]

Have you been able to confirm that AMD indeed disabled SR-IOV support on the Radeon VII? Also is the reset bug affecting Radeon VII?

[@olealgoritme6774]

it's disabled on the R7

[@johnnybegood8049]

Glad I've found you and your channels. Quality content for real.

[@plapbandit]

Shame these are so expensive, I never managed to get my consumer nvidia card to work with SR-IOV, I heard theres a tweak that works for some but not for all. I need an SR-IOV supporting gpu for my ESXi unit, mainly to help speed things up on my Shinobi instance but also useful for speeding up mycroft-personal-servers speech recognition. Great vid as always, thanks Wendell

[@festro1000]

I saw SimCity 2000 and Neverwinter Nights on the six monitor shelf. Very good games and Johnny Five with the remote have to admit got a nice nostalgia rush.

[@AdHdEntertainmentLLC]

You inspire me to learn so much more. Almost done B.S in Cybersecurity

[@justDIY]

Looking forward to this all maturing a bit more. I got all excited from your videos posted a few years back showing thread ripper running multiple VMs with their own pass-through GPU, and of course, I lost the silicon lottery and my newly purchased TR hardware won't do it, but my ancient Intel x79 that the TR replaced will. Go figure! Keep up the great work, love these type of videos.

[@EduardoRFS]

It's probably you motherboard and some bios hacks needed, all TR and Ryzen will do pass-through on GPU, but some boards sucks

[@noobulon4334]

Speaking of looking glass, linus did a video a while ago about using the video output-less mining cards in windows, would it be possibel to do this by passing it to a vm and using looking glass?

[@AxiomofDiscord]

I just want a stripped down VM to run XP with that can share my GPU to help accelerate older games. That could meet the emulation that is creeping into most 9x games to make a Modern PC entirely backwards compatible. Well outside known edge cases.

[@OOJokerOO1991]

Wendell doing gods work!

[@Gastell0]

The SR-IOV GPUs that consumers can get now are there, Radeon Instinct Mi25, but the software is not from the looks of it, neither qemu nor libvirt can utilise it as of today (thanks to VF token introduced 2 years ago in VFIO)

[@eduardofrazao9890]

I think that this is a very useful feature, that must be avaliable for consumer cards only. Will be very nice to use some high performance virtual machines here, without the need to inject a dedicated GPU on each.

[@nedolium]

Multiple VMs with Skyrim, planning for Skyrim Together there Wendell?

[@ChristianStout]

The FirePro S9300 is also a good option, and they're really cheap on eBay right now.

[@moldoveanu8]

From past experience with Unraid and gaming on that system with single GPU passthrough, I can say there is a big market for GPUs with SR-IOV at the consumer level. A gamer and content creator (they are everywhere) with an SR-IOV GPU and prppper software support, can for example run Linux along side 2 Win10 OSs on bare metal with shared resources. This would reduce the entry cost to market for streamers. No need for 2nd PC to handle tasks. There are other benefits too. Linux is relatively a safe sandbox to begin with, having your stream run through there with a VPN, would decouple the streamer from most kinds of malicious attacks from a rogue party while still being able to not interfere and not interrupting the gaming VM. I would even go as far as to recommend have multiple Linux VMs and only boot up the windows instances if the task you need to run only works on windows. And yet there are still more benefits to everyday people. Wih multiple OS instances. One can create their OS once and then make a copy. Keep the copy as an instant backup. We all know windows is not perfect, so having the flexibility to restore a backup in seconds and thus being able to remove viruses or broken software in seconds as a result, that's freaking amazing. Would save poeple time But because we don't really have a good example of a VM friendly multi instanced OS with simultaneous multi-vm GPU passthrough (Unraid being the closest it gets), then you get people that don't even know they need this ease of life technology. It's a shame our PCs could be doing so much more.

[@DavidAlsh]

I am 100% behind you on the consumer vGPU support. I could run Linux as a daily driver and still be able to have perfect support for my VR headset and all the games I want to play. With Intel releasing their dedicated GPUs soon, I wonder if they will support their GPU virtualization technology

[@johnbell1810]

@4:44 That looks like a plastic dust cover, not a real "dummy" plug

[@PcGameHunter]

Everytime Wendell says something will be on the Linux channel. I feel like that dog from Futurama just sitting there for the never coming linux video

[@tin2001]

What's that boy? You're walking on sunshine?

[@MrBiky]

1:45 what is that thing near the cards? Is it supposed to be a hidden reference or something?

[@kian8382]

Wendell, the kind of guy the world doesn't know it needs, is needed.

[@AlfieMakes]

Is there any good reason for SRIOV to be disabled on consumer GPUs or is this another of those cases where vendors lock functionality to help justify their 'higher-end' products?

[@AlfieMakes]

@Conor Hanley such a shame, this can be very useful for rural and educational situations. But the high prices of these devices makes it unfeasible.

[@jasonwicks7604]

I've been wanting this for nearly a year now

[@domainelangmatt]

Intel gvt-g works beautifully on my laptop. I hope it will work on their future dedicated GPU's. I would definitely buy one if that's the case.

[@fredrikmardenfalkhoppe494]

What hypervisor do you use when using gvt-g?

[@jeepo500]

SR-IOV on a consumer card would be enough to push me further up the product line. I don't game, and my low end GPU fans never spin, so it's really the only feature that would influence me to get a higher end card. If AMD introduces a consumer card with SR-IOV, that will get my entire upgrade budget, rather than splitting it with an nvidia card and a larger case/motherboard to accommodate dual cards.

[@bakakafka4428]

I keep thinking what than neat keyboard Wendel has is, with the touchpad on the right. Anyone know brand and type?

[@industrial-wave]

What is that wireless keyboard with the trackpad in the background? I've been trying to find a good one but they all seem to be cheap and awful feeling.

[@craigcordeiro8530]

Man, this would be cool on the current batch of GPUs. Also, it would be cool if any of the current batch of GPUs were able to be purchased from people that aren't scalpers.

[@streaky81]

They don't look at it the way it really is. They're actually hurting their own sales. The smart play would be to limit the number of VMs that can hook into it at a time - consumer end we only need 3 or 4 to do the things we need - rather than completely not allowing it.

[@tin2001]

Even 2 would do for consumer gaming. Maybe 3 if you wanted to have all your gaming virtualized. Another market they're missing is smaller businesses. Allowing up to say 4 guests to share the card would mean a small business can get started with cheaper hardware. Then as they grow, they would move to the more expensive larger versions. They forget that not all business users are huge corporations with millions of dollars to burn.

[@Pheatrix]

Correct me if I'm wrong but didn't AMD say their Vega consumer GPUs are going to support SR-IOV?

[@TheRangeControl]

Thanks so much Wendell. :-D

[@konstantinavramidis5436]

follow up vid on this would be nice!

[@morningreis5018]

Can you do a video on NICs? Why are some 1GbE NICs so expensive when an old $40 i350-T4 from eBay works just as well? What's the difference and what should I look for in a NIC? Thanks :)

[@hblaub]

I need more ... more power... more sharing... MORE!!!!

[@joshhardin666]

When can i pop a couple of 2080ti's in a linux box and be able to spin up a windows vm and play games either windowed or full screen without the need for a second gpu, monitor/kvm, etc? I've been looking at trying to move away from windows for the longest time but there are some software pain points (largely the adobe suite, virtual reality, and playing all the video games) if a gpu can accelerate a virtual machine while still providing output and acceleration for the underlying system you could run any os with solid virtualization underneath (linux) and anything on top of that (windows, os x, linux, whatever) without the need for additional hardware... i'm totally down, i've been asking for this forever. have all the advantages of all os's in the same environment without needint to reboot? TAKE MY MONEY!

[@Ishiku__aka_xchoibitschibihil]

hmmm interesting....

[@jeschinstad]

Right now, it only works for OpenGL, but VirGL provides that feature. They're still working on improving performance, but for me, it's working very well. Only OpenGL though.

[@antoarre]

Where can I find the "bookshelf" at 1:12.

[@isbestlizard]

Will the pro VII have sr-iov enabled? I LOVE the thought of running 6 heads from one box!

[@theIpatix]

I've seen these cool demos for looking glass here quite frequently. Unfortunately I did not have a very positive experience with that with Intel GVT. Once I've managed to start it up I had something around 1 fps and the mouse was jerking all over the place. Plus, it cannot display video before logging in (iirc). I'm still looking for something that works better than Spice or RDP with the claimed performance of Looking Glass.

[@DiyintheGhetto]

Hello i have a question. On the raspberry pi what remote program are you using to get the windows vm on?

[@LND3947]

This video took ages to appear in my notifications /subscription box, anyway, great video, I hope AMD implement SR-IOV onto their consumer Graphics Cards, a nice fully open source solution to GPU virtualisation supported on a Hardware level would be amazing, currently going through sn RMA process with a 2 month old RX Vega 64, looks like I'll end up upgrading to a Radeon VII at this rate.......

[@ujiltromm7358]

Now I want to build a computer for two Starcraft II players. It's not that demanding on the GPU so virtual GPUs can work.

[@TheLaurentDupuis]

Normally the Frame Buffer should only be sent back to the card video encoder for streaming. So it should not leave the card, only a nice MPEG stream.

[@BioToxin]

You need to tell Linus about this for his many editors setup

[@BioToxin]

3 years later, I'm finally to the point I need this, vgpus aren't cutting it anymore for pxe booting vms or other pcoip thin clients / similar remote desktops, I need vms to be able to share a very beefy gpu kind of as needed and just schedule each OS accordingly. pass through requires me to shut down a vm before handoff (why not hot plug ? why!?) and there's a very hard limit on how many gpus I can shove in my workstation both from pcie access even with breakout boards, and with power, and it's not like every vm needs full power all the time, I can pass 1 gpu for gaming but I'd like the video editing vm, the transcoding docker, and plex to share a gpu, windows figured out how to slice up a gpu where's the Linux equivalent?

[@beauslim]

What is that keyboard? Virtualizing gpus is fun stuff. I've played with it a bit, especially for remote gaming around the house via steam link or nvidia experience. The problems I ended up running into were always related to specific games not displaying. I think it had something to do with full-screen graphics modes.

[@irvingchies1626]

Is there any consumer level card known to have SRio V support?

[@PetrSUsername]

Hi! I definitely support, what you are doing. Thanks to you I'm currently switching to lnx + looking glass (FINALLY leaving windows behind!). Though I have one question - isn't the game streaming (onlive, stadia..) actually better? With proper connection of course... Or maybe just overall simpler for end user - you just grap laptop/tablet/phone or just the controller with almost ANY operating system - click cast (on tv or display) and start playing similar to console gaming..?

[@MajorArchitect-0]

Through trying to search that card I realized there is laptops with an S7100X, do they have a sriov? what interesting things could you do with a laptop that has it?

[@QualityServiced]

great video very engaging!

[@mattgeo5039]

was hoping to see a live demo of the thing at work .. unraid did something like this dint it?

[@piperis3412]

Do you know a list of SR-IOV compatible graphics cards that could work with Microsoft (HyperV 2019) DDA? -> Is the filter driver on the Linux hosts activated by default for AMD drivers and is a special filter driver for Windows also required?

[@tanmaypanadi1414]

Good luck Wendell

[@madant7777]

MOAR!!!

[@wilvanlierop]

Thank you wendell for your great Linux Videos! This is another great one. pd4z

[@user-xh5pi2nf9q]

Windows update borked my computer this week so I am back on Linux again. I want to see SR-IOV so that I can run my VM at full tilt. Also, with Stadia and all these other cloud gaming platforms popping up we need to be able to have this at home on our own network now. I started working on my computer years ago to get to a point where it could be several VMs all accessed via Raspberry Pis or low powered laptops and we are ALMOST there....JUST DO IT AMD!

[@bestbattle]

What is the name of that wacky keyboard on top of the desktop?

[@HulksterHogan]

Is SR-IOV more simple to set up than a GPU Passthrough? If so I would love to have it on consumer gaming cards cause the whole GPU Passthrough setup was a huge pain in the ass and through weeks of troubleshooting I got everything working except my CPU performance was awful and the audio was buggy, ended up giving up and moving back to Windows.

[@johanCferreira]

Is sit possible to use SR-iov with intel network cards? One card for all your vm's? Only using one pcie slot

[@plasmar1]

here watching this on a 12 core xeon(old) with 5 quadro 600's thinking I need SR-IOV in my life in someday land(only currently using 4 vm's as desktops)

[@LampJustin]

Oh yes you are sooo right!!!!

[@MrKartos1]

Any opinions about SR-IOV + KVM(Docker+QEMU) VDI?

[@johnpaulsen1849]

I thought when I looked at the AMD cards for work, over 1 year ago. They have a bios mode to limit the sr-vio so this didn't happen. Or I maybe thinking of a model of tesla that can run in that mode after a bois command....

[@itsdeonlol]

Great Wendell!!!

[@ArunG273]

Sorry if i didn't understand it correctly. Can I use this tech to run Mac OS VM with accelerated graphics on supported GPUs?

[@pronstorestiffi]

Thats some really cool tech.

[@Richb711]

what about ovirt haven't been able to play with it due to lack of hardware. Is it any good?

[@danielhabe4128]

i am working on a RTX 6000 + ESXI VGPU Setup for very heavy voxel rendering stuff..

[@dorinxtg]

They released few days ago the new of the gim kernel module. It got some modifications to the vbios and some fixes for Linux/Windows guest OS's mix (so you can run both) I have the S7150x2 but I don't have Threadripper. I will try to test it on Ryzen (neat trick: Buy the Zotac GT710 which is a version with PCIe X1 so your X16 is free for the S7150 card. www.zotac.com/il/news/power-pcie-x1)

[@Jagerbomber]

Did you click "Check for Solutions"? Did that help? ;P

[@joonasfi]

Or did you try turning it off and back on again?

[@TheRangeControl]

Any updates on this?

[@jumbee9]

Anybody know what keyboard he's got in the background? Looks like a living room keyboard.

[@hammadnadeemx]

Does the 5700xt support sr-iov ?

[@b2bb]

I need more! 10:23

[@sparkyenergia]

Apparently AMD really considered letting us have SR-IOV for Vega. But didn't for some reason. I would love to build a '2 gamers 1 CPU' like rig for taking to a lan (that's possible - PCI passthrough 2 gpu's). It would be amazing if I could run a third VM that could run the 2 GPU's in crossfire/sli (when used alone). Most amazing if I could run the two vm's for gaming but have say 20% of an rx480 go to one game (minecraft or a 2d platformer) and all of the other Rx480 plus the remaining 80% of the first rx480 go to a heavy game like Apex legends. But hey ya gotta have your fantasies right!

[@SleepyRulu]

Oh yes I love this idea I wonder this work on threadripper

[@theignorantphilosopher4855]

2 questions: 1. Does SR-IOV allow for dynamically allocated resources? Think 2 virtual machines with changing loads. My guess would be no, but better to ask 1.1 Could 1 non virtual machine, that is actually using the card, allocate some of the resources to a virtual machine you spin up, just as you do with the rest of the system resources like RAM and CPU cores? No as convenient obviously, but better than nothing. 2. Assuming that consumer card will not get SR-IOV, which seems to be a safe bet, would there be any significant drawbacks, apart from price, for a regular con/pro-sumer running an enterprise card?

[@Ishiku__aka_xchoibitschibihil]

hmm ...good one m8.

[@jeschinstad]

Intel supports this on iGPUs, so I'm hopeful their dGPU will as well. In that case, yes, you only need one GPU and let VMs get some of the resources.

[@mohnmann]

after my quick research i concluded that this radeon card is less powerfull than a 1080ti or am i wrong here?, im trying to realize a multi user setup for gaming for a few months now but im still failing, gpus are gtx 1080ti and 1060 6gb, cpu on the host is a 2700x and on the client desktop a 1600x

[@gnul]

Will RX 6000 (e.g. 6800 XT) support that? I really want only one shared GPU. And I can't afford anything higher than 6800 XT and I need that performance.

[@Maisonier]

no news about this?

[@melvinch]

How about running 4 Mac OS on this thing ? Is Looking Glass working like Teradici ?

[@MrBiky]

Not really. By passing one GPU to a VM, using Looking Glass you can copy the video buffer from your passthrough'ed GPU into your host GPU and display the content at very low latency. Additionally, you can use Looking Glass to also send inputs to the VM from your host. It works kinda like VNC or RDP, but only on a local machine, without requiring a network connection. @ 4:10 Wendell showed the passthrough'ed GPU connected directly to the bottom left monitor side by side with Looking Glass on the host in windowed mode in the top right monitor. I haven't looked through the code or tested Looking Glass myself, but from what I understood, in order to copy the video buffer from a passthrough'ed GPU to your host GPU, it uses some low-level "hooks" to grab the data. I'm also FAR from an expert in server stuff, but in this video, Wendell used SR-IOV and GRID to make many "virtual GPUs" and passed them to many VMs and used Looking Glass on them to copy the video buffer into the host's GPU and display it in windowed mode. I hope I am not mistaken and I'd like someone who is capable to respond with a better explanation.

[@cowardly_wizard]

Manjaro Gnome! The best of distros

[@ross4814]

The 'demon voice' MOOOORRRREEE

[@maxwellg1361]

Do the new AMD APUs support SR-IOV?

[@chadddada]

Any luck on this working better with RDNA2 / Next gen AMD video cards?

[@junkerzn7312]

Only Wendell would blow up a BIOS because his GPU card wanted to make lots of babies :-) -Matt

[@hansdruf9132]

this video is great, but the b-roll of the firepro the in the case is somewhat annoying

[@AndreiNeacsu]

Mr. Liar Pants on Fire Raja Koduri convinced me that Vega supports SR-IOV. Having access to a single S7150 (not the X2), I wanted that, so I bought 3 Vega 56. No support on consumer cards, not even the Frontier Edition, nor the Radeon Pro, it's just a couple of newer server cards that support MxGPU. That was a big disappointment, as I was hoping for at least one VM on top of the host, or two under a low-level hypervisor. Ideally, four would be truly awesome on Vega 56/64 (pro), Vega FF, and Radeon VII. Another lie of Raja was that Liquid Sky will be using Vegas. I bought some credit and set up a machine there, but they only used Intel Xeon CPUs and Nvidia Grid cards. I did not even use the credit and my account expired.

[@carbonsx3]

10:18 MOAR!!! 🤣

[@Netist_]

Though I usually buy AMD CPUs, and I love my ryzen, I've typically been an nvidia guy as far as GPUs are concerned. But if AMD released functional SR-IOV on their gaming cards, I'd buy a top-of-the-line AMD GPU in a heartbeat

[@user-yx8jd7bl9s]

so it's ok to buy Nvidias expensive workstation cards but when it comes to AMD they have to enable SR-IOV on their gaming gpus !!......

[@Netist_]

@@user-yx8jd7bl9s ...what?

[@mr_beezlebub3985]

So is this the technology that will be behind things like Google's Stadia?