How to setup NVIDIA GPU for PyTorch on Windows 10/11

Go to strms.net/fact... and use code FACTORSE35503 for my special Factor75 discount and to support my channel! #ad
This is a tutorial video on how to setup NVIDIA graphics for using it with deep learning library PyTorch.
Links used:
Visual Studio 2019: visualstudio.m...
NVIDIA CUDA: developer.nvid...
NVIDIA CUDNN: developer.nvid...
PyTorch : pytorch.org/ge...
Code to test:
import torch
print(torch.cuda.device_count())
print(torch.cuda.get_device_name(0))

[@laurencooke3087]

Thank you so much! Finally got it working thanks to you (same steps worked for me with Visual Studio 2022). Thanks again!

[@oluwasegunbankole7794]

Where you trying to run roop cam because i am getting torch module not available

[@Remy1080]

THANK YOU SO MUCH, WHY DID NOBODY TALK ABOUT CUDNN BEFORE OMGGG

[@GregoryCarames]

So all the problem I had during the entire time was the CUDNN runtime missing? incredible... Thanks dude, great video!

[@kasialovska1206]

AssertionError: Torch not compiled with CUDA enabled

[@syed7110]

Do you know how to solve that error. Can you tell me? Please 😢

[@staggeredextreme8213]

Can you pls help 😅?​@@syed7110

[@phucminh8354]

Me too with my rtx3060😢

[@JustArtsCreations]

uninstall torch and recomplie with CUDA it happens sometimes

[@lemikey643]

Question.. Why is it VScode 2019? is it not compatible with newer versions?

[@inc0gnito590]

How to set the path variable if it is not set already by default?

[@legendary2192]

Thank you so much

[@PriyankaGadhavi-c1o]

after doing all steps, in last got below error: import torch ModuleNotFoundError: No module named 'torch' I have RTX 3060 and I installed version of Cuda 11.7 toolkit

[@wishwarathnaweera2292]

u fixed it? i havbe the same gpu and same cuda version got the same error

[@SasaniPerera]

guys I get the same error. Did any of you solved this?? Please help.

[@SasaniPerera]

@@wishwarathnaweera2292 my guy did you solve this?

[@SasaniPerera]

@mateussantos6755 my guy did you solve this?

[@wishwarathnaweera2292]

@@SasaniPerera tried for days and fixed from referring to some other videos , i was using this to train a speech recognition model. bt unfortunately it could not support such a power using the gpu so i shifted to colab pro Version and did my task . If you trying to train models with much computational powers i would not recommend this method

[@suteguma0]

i only have intel GPU on my laptop and no nvidia hardware. Is that why I cant use cuda ?

[@SL7Tech]

Yes you need a Nvidia GPU

[@shubhiagarwal8958]

I tried to install CUDA and access GPU to do my projects. I used visual studio 2022 and cuda version 12.4. I followed the procedures and device count was showing 1 , I had uninstalled and reinstalled pytorch. Now today, 1 day after after trying to access gpu, now it is showing device count to be 0. Please help 🙏. Do we have to set path for pytorch or visual studio or is there anything else i am missing

[@tanmaychavan606]

did you find solution to it please help me!!!!!

[@globbyboi]

THANK YOU SOOOO MUCH THIS SAVED ME!!!!!!!!!!!!!!!!!!💝💖💗🧡💞💕💜💗💙💓💖💛💛💘💘💝🧡❤‍🔥❤‍🔥❤‍🔥

[@orochi7749]

after long journey on reading docs and tutorials. Finally, I did after this amazing videos. Thank you so much

[@uzudt]

Mine saying AssertionError: Torch not compiled with CUDA enabled when I run test on py

[@vladyslavhnatiienko1902]

I am encountering an OSError: [WinError 126] with PyTorch on my Windows system. The error message states: "The specified module could not be found. Error loading 'shm.dll' or one of its dependencies." This occurs when trying to import PyTorch in my Python script. Despite the error message indicating that the module could not be found, I have confirmed that the shm.dll file does indeed exist at the specified path: C:\Users\user\AppData\Roaming\Python\Python312\site-packages\torch\lib\shm.dll. I have verified that the DLL is present and correctly located, yet the error persists.

[@businessgamerprb5398]

Use chatgpt 4 It will solve the error... Chatgpt 3.5 is waste... So consider buying the paid version.... Or use chatgpt 4 until it expires and it will be available again in some time...

[@shivampadmani_iisc]

Downgrade version of pytorch to 2.3. error will be gone

[@Polycephalum-AI]

@@shivampadmani_iisc Dude. Lifesaver. Thx.

[@D_A_R_K.]

​@@shivampadmani_iisc bro I have now uninstalled all the things I have installed for cuda torch ....now I am re installing ....if the same error occurs once again .. does have to install pytorch 2.3

[@penrose3477]

You are the best, thank u !!

[@tomdapchai]

worked with VS 2022 17.11, CUDA 12.1, CuDNN 8.9.7, PyTorch Build Stable (2.4.1), many thanks :)

[@Arun-ku7kq]

really helpful. i had almost bought new device.. you saved me man

[@hallaibrahim6557]

is that compatible with vs code 19.3 or only vs ?

[@PMTech-f9h]

Is anyone having trouble with Torch and CUDA in Stable Diffusion? Is that why you guys are looking for this? I am asking because I have that problem, and I want to ensure I am in the right place.

[@tejaspatel6965]

YOU ARE A SAVIOUR😭 I am trying from past 2 days for my ML model project. Thanks a LOTT!

[@nomanalikhan9998]

you saved my 10$ that i was going to spend on the google collab

[@vuyombam4872]

You're a godsend mate, thank you very much!

[@lihuasuk3684]

😢😢i can not do it.why why i use intel core i 5 help me please 😢😢

[@manighahremani9040]

Can vouch for this video! Tried Anaconda and any other piece of advice that Bing/Bard or Copilot could spew out and none of them worked until this!

[@asylzatazaev3990]

python -c "import torch; print(torch.__version__); print('CUDA Available:', torch.cuda.is_available()); print('CUDA Version:', torch.version.cuda)" >> 2.3.0+cpu CUDA Available: False CUDA Version: None. Did everything step by step, but facing dead end, chatgpt4 also giving cycled answer which didnt change anything. The error says not found cuda, in reality it is too hard to find out why it is not available

[@iNTERnazionaleNotizia589]

what GPU you have? Rtx? Gtx? Mx?

[@tanmaychavan606]

did it worked please help me!!

[@Songobu2]

Thanks a lot bro, I have been trying to install this for months but none of the youtube video work. Only your works!! You saved my entire dissertation process! 1000 likes for you keep going bro

[@iamragulsurya]

thanks bro, very much appreciate it

[@plumberski8854]

I use Pycharm. Do I still need to install VS ? Thanks.

[@Maryammmmy]

thanks, it was pretty helpful :)

[@mr.entezaee]

11:11 The system cannot find the file specified.

[@Максим-х2ж4с]

Исчерпывающе. Всё получилось.

[@adityamohanta8902]

Visual studio 2019 can't be downloded. It says "Sorry, we couldn’t find your subscription".

[@SL7Tech]

Choose the community version

[@ahmedchaoukichami9345]

i have rtx 3070 when i exucute (nvidia smi) i get cuda version 12 how can i get pytorch 12 version and wich cuda version should i install and cudann and toolkit plz

[@abeerilyas8337]

Stuck in same situation. Please let me know if you get any solution.

[@RedSky8]

Try this !pip install torch==2.3.0+cu121 torchvision==0.18.0+cu121 torchaudio==2.3.0+cu121 You may need to add the https url at the end too. Just past it into chat gpt and it should finish it for you.

[@diegomiguelvillamil4833]

Thanks for the tutorial ❤

[@RizaShiro]

It's just another comment, but I feel the need to tell you how grateful I am for this. You did every step slowly, waiting on it, you didn't assume we know stuff, so it was super easy to follow and it actually worked!!! Honestly, thank you so much, sending you lots of appreciation

[@MrStark-kn6xb]

W mans this tutorial is a life saver

[@mechamongrel-ir2qt]

Thank you! But as I understand, PyTorch ships its its own CUDA runtime dependencies so for PyTorch, actually you dont need a locally installed CUDA toolkit.

[@terrance7300]

Thanks for the video! Now I don't have to depend on unreliable Google Colab GPU resource allocations!

[@AnzuYT]

you the best

[@rishisharma5252]

thanks bro works on 1050ti

[@Arun-ku7kq]

very informative

[@hurriken1142]

I've been struggling with this problem for a long time. Thank you so much

[@deltamico]

When I try to dowload the installer zip of cuDNN it says the file could not be found. It happens both for the newest version and the one you showed, what can I do?

[@Road_thefuture]

Thank you so much!

[@mspgamer6800]

Bro, i has to comment cause this is soo detailed and understandable video or solution explaination ....not only commenting but also i subscribed u...never stop making video ...love from INDIA

[@javlontursunov6527]

why are u specifically installing visual studio 2019 ?

[@ParkGo-xp9jz]

thaks man i have been trying hard to install it on my PC. Approach from video worked like charm...

[@kulatakalanene]

nice, thanks

[@learnwithbasics6478]

I am straight but mannnn, I love you. fixed my problem. having this issue for 3 days. Thanks. God bless you mann .

[@anthonieschaap1625]

Thank you man, invested a lot of time trying to make it work, failing with guides and other videos but this one did it

[@ferroumsamir6531]

Thank you it worked perfectly with CUDA 11.8. but i installed Visual studio 22. but still everything worked fine.

[@aritradaschowdhury5539]

thank you so much

[@davethinkingsystems]

Thanks very much for this. I tried a couple of evenings and couldn't get PyTorch to recognise my GPU in Pycharm, it does now so I'm ready to rock and roll. Thanks for your help, I really appreciate it.

[@javlontursunov6527]

Now I have visual studio 2022 community

[@xberna8156]

Thank you very much!!! It worked❤‍🔥

[@captainmustard1]

perfect its working for me. thank you!

[@albertwesker2k24]

Thank you so much! Liked and subscribed

[@tufanerhantürkoğlu]

Thank you very much, it was useful

[@viniciuscarvalho2881]

thanks bro

[@heatherbrm]

My Thesis thanks you!!! (And I do too!) 😁

[@user_name_lol]

Thank you very much, man! Finally normal step-by-step tutorial how to do it! It still works in Apr 2024.

[@haroldentimano3562]

how to fix this error? i did the step but error Traceback (most recent call last): File "c:\Users\Harold Mart\OneDrive\Desktop\python cuda\cuda.py", line 4, in print(torch.cuda.get_device_name(0)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "C:\Users\Harold Mart\AppData\Local\Programs\Python\Python311\Lib\site-packages\torch\cuda\__init__.py", line 419, in get_device_name return get_device_properties(device).name ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "C:\Users\Harold Mart\AppData\Local\Programs\Python\Python311\Lib\site-packages\torch\cuda\__init__.py", line 449, in get_device_properties _lazy_init() # will define _get_device_properties ^^^^^^^^^^^^ File "C:\Users\Harold Mart\AppData\Local\Programs\Python\Python311\Lib\site-packages\torch\cuda\__init__.py", line 298, in _lazy_init torch._C._cuda_init() RuntimeError: Found no NVIDIA driver on your system. Please check that you have an NVIDIA GPU and installed a driver from www.nvidia.com/Download/index.aspx PS C:\Users\Harold Mart\OneDrive\Desktop\python cuda>

[@tanmaychavan606]

did you find how to solve this error please help me

[@abdullahiabdulwasiu]

Thanks But can this be install inside of anaconda?

[@LaiThe-l7h]

Sir, I have followed your video and achieved great success. It works perfectly with CUDA 12.4, CUDNN 8.9.7.29, Visual Studio 2022 version 17.11, and PyTorch Build Stable (2.4.1). Love from VietNam

[@baha1.099]

It works for me too

[@hussainmir05]

anyone can help OSError: [WinError 126] The specified module could not be found. Error loading "C:\apps\python\lib\site-packages\torch\lib\fbgemm.dll" or one of its dependencies.

[@D_A_R_K.]

Same here is this solved?

[@kanavsharma2609]

Thanks. It worked Like a charm

[@huntal3538]

thank you so much. I followed step by step anhd it worked.

[@syariffortask]

Tell me why you using visual studio?

[@JustArtsCreations]

Required to install CUDA

[@deda2022]

Hello friend, I encountered a problem while installing CUDA Toolkit 11.8. ,, This message appeared during the installation process... running processes (the following processes must be stopped before the Cuda Visual Studio performance monitor (process ID: 7284). Is there a solution to this problem, please?

[@deltamico]

still unsolved?

[@deda2022]

@@deltamico ... yea, There is still no clear solution.

[@deltamico]

did you try to look up which process it is and stopping it manually

[@NiharAsare]

5 days stuck and got a solution in 13 mins. Thank you so much!!!

[@Douglas117955]

Thank you so much I could not get it to work but now I can finally code in peace

[@itsme9877]

Is intel(r) iris(r) xe graphics gpu compatible?? Stack overflow showed it as not compatible and i want to know where exactly dis you try it on.. I am havin a mini project to be submitted n i m struggling to get this done. Please help me asap

[@iNTERnazionaleNotizia589]

CUDA is for NVIDIA GPU Only,,,,, Intel Iris can't use CUDA

[@hi-kc7sb]

one of the best video complete information. Thank you bro.

[@ramazan.6781]

You're amazing man, thank you so much, I've been wanting to do this for years but I couldn't. but now i made it

[@mahadyhasan8566]

With all due respect, I don't how if others feel like me, but I feel butt irritated with the sound of your noisy mouse and keyboard. I also have them but i wouldn't have use it in record.

[@SL7Tech]

Noted.

[@hyena-ai]

The only video that worked for me

[@blaine_stl]

this is awesome, this worked perfectly for me. I've been running my ML programs on cpu assuming that I didn't have a gpu that was accessible since torch.device("cuda" if torch.cuda.is_available() else "cpu") didn't recognize a mounted gpu. This video helped to resolve that, diffusion models running so much faster now

[@WahabKhaddim]

amazing content dude ! Loved the straight forward appraoch

[@andonic]

You are a god thank you

[@krishitpatoliya779]

says no mudule named torch

[@cornerwayne3442]

can it works for lower gpu in laptops?

[@shahirsizan18]

Thank you very much

[@SainathLatkar]

Thanks mate. You are a savior!

[@jain78343]

Worked like a charm, thank you so much!

[@bharathrajupeta9633]

ur a life saver brother ❣

[@NguyenPhuc-zo8ny]

Finally I success install Pytorch Cuda. Thanks bro a lot

[@mr.naveenkuhar]

Thanks mate it worked perfectly

[@dealeras2143]

Worked!! Thank you!

[@bboyect]

Thank you so much. Massive help!!!!

[@lucaanzaldi1526]

You save my life!!!!! I love you!

[@Feciboy]

Thank you so much!

[@keshavsinghal643]

Thanks man, so much, the best tutorial I found on youtube to setup cuda in your workflow...

[@josephthe2nd395]

Thank you for this tutorial, saved me 2 times already.

[@rochakbhusal10]

DISLIKED BECAUSE MY DOG LEFT ME

[@Ashok-py5mt]

Thank you bro! I should have watched this video one day before. Could have saved time

[@SayanChowdhury-h2h]

Hello, thanks for the amazing video. I already have installed a different version of CUDA (10.2) and CUDNN compatible with a partiicular Tensorflow version in my system. What should I do ?

[@ojaspatil2094]

thank you soooo much!

[@sohamk1234]

Thankyou so much. Was struggling with CUDA installation from quite long, this video helped me install it successfully.

[@xande21041969]

Thank you man!

[@anujjha625]

You are a saviour. Thanks for this video. Works like a charm.