Setting Up CUDA, CUDNN, Keras, and TensorFlow on Windows 11 for GPU Deep Learning

[@Virat-Srivastava]

Thankyou Sir... Cant express how happy i am after seeing this work. worked for 3 Days to find a correct guilde for this. 5 windows reset so previously experimented stuff don't mess with new installation. Note that version of Tensor flow compactable with this method is till 2.10.0 . after that you need wsl which whole new level of headache to install. 18:35 at this point just change to install tensorflow==2.10.0 . after this follow everything Jeff says.

[@HeatonResearch]

Thank you for the update, glad it works! This is a really good point, TensorFlow no longer supports native windows install (like this video does) beyond 2.10.0. Future versions need WSL2. I will be posting a video on this next week.

[@DukeOfCurling]

I currently tried everything except for this one...wish me luck...nothing. even that didn't worked. This is tremendously upsetting me that all this process is so freaking hard to get it right. Any other suggestions? PATHs are correct as the tensorflow version too. I installed the latest cuda which is 2.12 nd the cudnn files but no luck

[@cannabaro14612]

​@@HeatonResearcho Please...man.. I need big help to use cuda with 2.11 tf..........T.T

[@steveszeto8968]

@@HeatonResearch Sorry, I can't use it successful and it output the bug of unfound the lib with cudart64_110.dll. However, I have it. Should I install again with it?

[@itsbxntley2970]

@@DukeOfCurling Me too,ended up with false on gpu...think the only option is to try the tensorf version 2.10 or with wsl2 trying that now

[@creative_cooper]

Wow... I spent the whole day yesterday struggling with tensorflow gpu installation. Finally got a solution!. Thanks professor.

[@HeatonResearch]

Great, glad this was helpful.

[@jamilamuhammad5717]

Jeff, I can't help being excited as this great tutorial set to be my research savior. I have been struggling with this since mid 2021, you are great. Thanks a bunch.

[@abdullahaftab166]

Great! it works, after following the entire video. I used this to install tensorflow correctly and avoid conflicts (pip uninstall tensorflow tensorflow-intel keras tensorboard pip install tensorflow==2.10.0 keras==2.10.0 tensorboard==2.10.0 protobuf==3.19.6 flatbuffers==2.0)

[@kylo404]

it shows there is no 2.10.0

[@kylequinn1963]

You are a god-send. I could not for the life of me get CUDA to install properly, turns out I needed to install that MS community edition software first.

[@Stray_Spectre]

I followed along for the cuDNN part trying to get it to work with a different program. I remember banging my head on a wall trying to get it going on my old Win 10 machine and couldn't figure it out on my new Win 11 machine. Adding the environmental variables did it. Your attempt to make this age well worked, as it still works with Cuda 12.1. Thank you so much.

[@D12075]

19:55 TRUE. Thanks for putting together a straight-forward guide on this. Many Saturdays were ruined in 2020 when I tried to do this, messed up and had start over!

[@deepanshuchauhan8467]

Ah finally, after 3 days of doing this and doing that i finally found an actual video which helped me to install tensorflow.

[@NeerajGupta-ot9eq]

Providing simple seamless setups, doing gods work!

[@meaburro8591]

cannot express how happy i am to have come acros this video. I may have sunk 5+ hours with all the installations. thanks a bunch

[@sandeepg9921]

Sir, thank you very much for this tutorial. I was performing this task since 6 hours but in vain. At last got to see your tutorial and finally helped me get the GPU for the Project work. Much appreciated, thanks a lot.

[@harshwardhanfartale]

Thank you so much for this video! I followed everything in this video perfectly down to the last-minute detail and it worked for me! Also yes you need to install tensorflow version 2.10.0 for this to work! Thank you!

[@tomerbrio4409]

Thank you ! Just a little update regarding the installation of ip kernel. Run the following command: conda install -c anaconda ipykernel

[@Andah69]

love how you opened the windows gui to set the paths!

[@Ingo-ns3qp]

Sir Jeff, thank you so much! I was able to set up the CUDA stuff (following your detailed explanation) and can run the NVIDIA code samples from GIT. I am really happy! Again, thanks for this video.

[@bobparker6769]

Third version of tensorflow installed since 5/20/20, using your instructions; install ran with no issues, many thanks.

[@D12075]

Jeff, it's like you're one or two months ahead of my hardware purchases! I was looking for windows 11 support because I sold my deep learning rig (I overestimated utilization % outside of work, and downshifted to an RTX laptop on sale. For those reading, a dual 3090 setup works quite well if you can find AIO water-cooled cards and acquire them at a good price.) I ran the numbers and for $20-30/month, I can just push my workload to databricks on GCP when I need it.

[@alimoghimi8532]

Thanks for your great tutorial video. I had so many problems with setting up tensorflow on GPU before seeing your video.

[@HeatonResearch]

You're welcome!

[@Thotokk]

Thank you for the nice explanations, I really spent days trying to fix this! I also got some DLL errors, although I did it exactly as in your video. In another guide they copied all the cudnn files in the Cuda subfolders, which seems cleaner. They also added two other lines into path as v11.7\bin and v11.7\libnvpp and the other two v11.7\extras\CUPTI\lib64 and v11.7\extras\CUPTI\include. That worked for me

[@driesmichiels4184]

After following this video, if you're kernel stops after you try to train a neural net in jupyter and your anaconda prompt says "Could not locate zlibwapi.dll. Please make sure it is in your library path!" Try to locate this file in “C:\Program Files\Microsoft Office oot\Office16\ODBC Drivers\Salesforce\lib” and copy pasted this file into “C:\Program Files\NVIDIA GPU Computing Toolkit\CUDA\v11.6\bin” This worked for me!

[@infiniteworld6919]

Thank you sir you just cleared my concepts due to which i could allocate my gpu in latest version

[@danielmacedo1910]

Mr. Heaton! Thank you very much!! You are amazing!! It just helped me a lot!! Due to my GPU hardware (GTX family), I had do install precisely as you've shown and worked perfectly!! Oh, guys, I had to use TF 2.10

[@patrickhennessy4634]

Thank you so much for this - you made the installation and setup seamless!

[@tanhongkiat8196]

Thank you Sir for the detailed tutorials! I have spent much time trouble shooting these issues! Now I am ready to learn more on machine learning!

[@devchoudhary8892]

this is the best tutorial on cuda setup

[@lucysumi6853]

I watched so many tutorials and googled search, finally your video worked for me. Thank you so much.

[@rishabhsheoran6959]

Very helpful video Jeff! Thanks a lot! I was unable to see my GPU for: tf.config.list_physical_devices() I found out that tensorflow does not support gpu after 2.10.0 for Windows so I got that version and python 3.9 or 3.10 and finally everything worked. If anyone is facing the same problem, follow jeff's steps and use the above configuration I mentioned.

[@kingtut11]

Jeff... i love you. thanks for providing a thorough af guide.

[@jams2blues]

You are awesome Jeff, thanks for doing these videos they have helped me significantly

[@AhmedKhaled-oq9rx]

i can't tell you how much i appreciate what you have done, thank you ♥

[@torfa5309]

I don't advise you guys to follow this guide ...the CUdnn version he installed will not work with the CUDA 11.5 when u are doing an image processing model. you need CUDNN 8.2 with cuda 11.5

[@no-sn3gt]

May I ask what are the full versions you used - for 11.5.x & 8.2.y, what are the x & y? Also what versions of tensorflow and keras did you use? Thanks!

[@torfa5309]

@@no-sn3gt 8.2.0 and the same cuda version he installed in the video

[@torfa5309]

@@no-sn3gt and regarding tensorflow it doesn’t matter which version you are using

[@shubhamojhaa]

i love you with all of my heart. thank you so much for this Jeff!

[@mohammadsalehipak3194]

The best video found after one month

[@lucuzzo96]

Professor, I think I love you... You saved my day!

[@HeatonResearch]

Glad to hear it!

[@marc1190]

So for anyone experiencing DLL problems the issue seems to be with the manual install of CUDA (as opposed to conda) which automatically adds some values to PATH. If you select the most recent version of CUDA to install (I chose 12.x) these values are not what TensorFlow 2.10 is expecting hence it can't find the DLLs. Tensorflow 2.10 is required since that's the last version which natively supported GPU. pip install tensorflow==2.10 So if you do want to proceed with the manual install then I'd imagine you need cudatoolkit=11.2 cudnn=8.1.0 in order for it to work. I didn't test this, I just installed them via conda "conda install -c conda-forge cudatoolkit=11.2 cudnn=8.1.0" and its working now. Thanks to @Jeff for helping me see the wood for the trees!

[@eugenesagan5203]

Thank you very much for the tutorial. Does TensorFlow (2.7.0, the latest) really work well with CUDA 11.5? I have CUDA 11.6 installed, but TensorFlow requirements say it needs to be 11.2. So I'm having doubts about whether I should install TensorFlow regardless of that, or find some way to downgrade CUDA.

[@TheShekhar91]

Can you share how you resolved this issue?

[@j3rry837]

So, what's your solution? Did you reinstall windows in the end?

[@dimane7631]

The same issue

[@irrelevant_idea]

Thanks very much. Tried many ways but today it worked successfully👍...

[@himanshukandpal5585]

Hey Satyasheel, in the latest tensorflow documentation, i cannot find any paths for cudadnn. did you skipped that part?

[@SpiritVector]

I can definitely tell you absolutely love Microsoft buddy.

[@timothysimard5767]

Thanks for your attempt to clarify this process. I've been struggling to get this to work for days now. I was hoping that following along your tutorial would do the trick, but no luck. I'm using an NVIDIA GeForce RTX 3060 Laptop GPU on Windows 11. I've experimented with multiple versions of Cuda, cudnn, python, and tensorflow, but nothing has worked. I'm about to throw my computer against a wall. Any chance I could reach out personally? I feel like I need some hand holding at this point.

[@zeuztrumpeter8014]

Experiencing the same problem after watching this, I also have an NVIDIA GeForce RTX 3060 Laptop GPU on Windows 11, any solution yet?

[@timothysimard5767]

@@zeuztrumpeter8014 Unfortunately not. I tried emailing the creator of this video to see if he had suggestions, but got no reply. I've had other things to work on so haven't sunk much more additional time into it. I hate having my own GPU only to use remote computing to run things because I can't figure out how to get this to work.

[@mikeguitar-michelerossi8195]

@@timothysimard5767 Found any solution? 4060 laptop gpu here.. and it doesn't work

[@popi3789]

Thank you SO much. I've been looking for a solution for days to force a ML algo to go through my GPU, and I couldn't get tensorflow to detect my GPU accurately. I can tell you the heaven songs played for me all right when I saw the "True" ^^ Also I precise that I had to stick to Cuda 11 (I chose 11.2 according to the compatibility tables of tensorflow/cuda/cudnn) and tensorflow 2.5, because as I understood, tensorflow now doesn't work anymore for windows. Let's see now whether I can launch my script through the GPU in Jupyter...Fingers crossed! Thank you again though :) 🤩

[@yuvisingh12345]

Thank You so much. Finally able to use the GPU

[@plumberski8854]

Hope that you can shine some light for me. I just got a 4070 GPU (for Python AI learning). Installed Pycharm, tensorflow, keras, etc. Tested running it with CPU only and with GPU. About 80 times faster with the GPU. What you have shown here is a lot more than what I thought. And the many steps worry me. With the installed Tensorflow, I thought then it will use the CUDA cores. Do I need to do what you have shown to make use of the CUDA? A ball park figure, how many times faster will it be with just tensorflow and with CUDA installed? Many thanks. P/S Thanks for this video. Nvidia's instructions are too advanced for me to understand. Guess due to the many steps, and complexities.

[@ChaiTimeDataScience]

One day I will convince professor Jeff to switch to Torch (and also JAX)!

[@HeatonResearch]

I do Torch as well... this video happens to be on Keras. :-)

[@askerycanabarro]

Quick tip. If you have a laptop and your GPU is working fine, please skip step 1, as it can mess up your graphics. For desktops, I do not see a problem.

[@lucasbaroneperes1903]

The only video that solved my issue!

[@traida111]

Fantastic tutorial, but unfortuately mostly superseeded by changes. you no longer need to install CUDA and cuDNN directly on the Windows side to enable CUDA functionality in WSL. NVIDIA has provided native CUDA support for WSL 2, which simplifies the setup process and makes it unnecessary to involve the Windows-based toolchain.

[@lingfeizhang9411]

Im getting that the len is 0 (so no GPU found), but with no error message. Would you have any ideas of why that could be the case?

[@isaackafshkanan509]

Thanks Jeff 🙏! Will Pytorch gpu work aa well or we still need to type " conda install Pytorch torchvision torchaudio cudatoolkit=11.3 cuDNN= 3.2 ?

[@vijayalakshminiranjan276]

Hello, Sir. Thank you for posting the installation video. After installing Visual Studio 2022, I have a question. I installed Cuda 11.5 as you recommended, but it reports that no supported version of Visual Studio was found. Some CUDA toolkit components will not function properly. To get full functionality, you must first install Visual Studio. But I already installed Visual Studio. Could you please assist me with this problem? Reply me ASAP

[@adityay525125]

Although it doesn't help much but torch handles all dependencies via the pip. Just hoping that TF gets to the same kind of support sometime down the line.

[@HeatonResearch]

Yes, agree... installing PyTorch with GPU is a much shorter video.

[@deepanshumusicongo2172]

This video solved a lot of trouble for me .... Thanks

[@danielotero8281]

It helped me a lot, thanks for doing this!

[@redfield126]

Thanks a lot for this tutorial. I would be interested in having the same for Ubuntu . I am beginner and love the way you approach things. Thanks a lot again

[@redfield126]

Forget about my question. Just watched your video on WSL2. Looks exactly what I need. You made my day. Thanks again for the great content

[@martinpiceno10]

Thanks a lot, this was very helpful and a great guide.

[@akshaydongare2136]

Thank you so much for this! Very helpful!!

[@HeatonResearch]

You're so welcome! Thanks!

[@AegeanEge35]

Thank you for sharing this clear explanation

[@puranjitsingh1782]

I've installed cuda toolkit 12.3 and am not able to run gpu using tensorflow on that

[@aliali-sj9jp]

Thank you for this wonderful explanation Professor . I have a question I don't know what made me think about this . but I have a laptop with a processor intel(R) Core(TM) i7-7500U CPU @ 2.70GHz 2.90 GHz. Can I Set Up CUDA, CUDNN, and TensorFlow GPU on Windows 10>>>>thanks very much

[@ChintanShah-z3w]

hey there! sorry for off the topic question, but which display monitor do you use?

[@nachohotdawg5634]

It was false for me at first, problem was I had both cuda and cudnn with latest release so I had to downgrade them, then had to unistall tensorflow and reinstall it, and now gpu is true!

[@MegaNurri]

Thank you so much! This worked like a charm! 👍👍👍 Takes a lot of space though 😅

[@HeatonResearch]

Glad it helped!

[@NihalKumar]

Cuda 11.6 only supported with windows 11 now, which version u hv installed

[@kylo404]

every thing mentioned is installed properly but the output is coming FALSE also checked line by line dir in cmd but everything is available what is the reason?

[@roopanagbhushan7255]

In TF Install Guide , it was mentioned to install MS Visual Studio 2019 , and you have installed 2022 version , won't it cause a problem??

[@fatemeetsluck]

I have no idea what I'm doing, I've got this Nvidia 4060 RTX Ti, installed the CUDA drivers, and all the python scripts I run always try to allocate on the PC RAM instead of using the GPU.

[@sohamagarwal00]

Thank you so much ! My GPU mx150 is still pretty bad xD cant see much difference. But it works!

[@e101sg]

I prefer to use Anaconda...with Windows ; afraid i mess up with Drivers and system files. It may not be very latest... but it gives safe feelings. Above all, i at beginner at ML/DL and getting Dell Allienware R13 with RTX 3060 (12GB) / Intel i7 (32GB DDR5 RAM ) this week. but wish to try dual boot with Ubuntu sometime later. :)

[@HeatonResearch]

Anaconda works well too, for sure.

[@andrewh5640]

Thank you as always!

[@HeatonResearch]

You are very welcome!

[@ninjalennon1244]

Great video, thank you so much!

[@sievo666]

Doesnt matter what I do i seem to always get false. (yes i have a nvidia 4090) been through the vid thrre times now

[@garriedaden4168]

Very helpful. Many thanks.

[@askerycanabarro]

Thanks Jeff. A lot!

[@tintesamet]

not work cuda 12 with tf 2.12, you must use mostly 11.5 with tf2.10, i got it (: Thanks for video

[@PranavPandit]

The tutorial works perfectly well.. Although, when I come back to the code 3-4 months later the environment never loads and tf. does no find the device.

[@zainkhalid5393]

have you found a solution?

[@PranavPandit]

@@zainkhalid5393 no, not yet

[@roopanagbhushan7255]

Can I just install Visual Studio C++ redistributable only ,, or is the whole MS Visual Studio needs to be installed??

[@pranav9176]

thanks a ton, this was quite helpful

[@SefaBlacksmithson]

you are the best teacher thank you

[@DukeOfCurling]

After all this still not working for me I have a 3060 and still return just the cpu. The PATHs are correct, the conda env correctly installed as all modules etc.

[@EmericaTheTour]

Hello, could you do update, how to install everything, because as of today (december 2023), there are versions of TF that don't support GPU. I would love to see, how to get over it right now.

[@kenchang3456]

Similar question as @David White, if you install CUDA, CuDNN on Windows 11 and you want to also use WSL2 do you need to do CUDA, CUDNN installs on WSL2/Ubuntu?

[@HeatonResearch]

See my reply to him. Its on my list to revisit. If you use WSL, you only need the NVIDIA CUDA drive installed at the host level, CUDNN, C++, etc would all be inside of the images. The fact that they are claiming Win11 no longer requires insider edition of Windows means WSL might be an option. Windows random reboots would still be an issue for a serious ML workstation. Generally I unplug internet during a multi-day train in Windows, which is the only really foolproof way I've found to guarantee that the machine won't shut me down and install an update. I could probably refine that approach and just block the Windows update servers.

[@kenchang3456]

@@HeatonResearch DAMN YOU'RE QUICK! And oh, HAPPY NEW YEAR. Best wishes in 2022.

[@telecathodique]

I can't thank you enough ! ❤❤❤ But be careful and install tensorflow 2.10 (pip install tensorflow==2.10) because tensorflow 2.11 does not work.

[@vikaskatla]

🙏🙏🙏 sooo kind of u it works works workss thanks man

[@telecathodique]

@@vikaskatla No problem man ! 👍

[@repia9290]

You solved my problem.thank you!

[@piyalidas]

i am not able to statrt jupyter note getting following error"book (base) C:\Windows\System32>jupyter notebook Traceback (most recent call last): File "C:\ProgramData\anaconda3\Scripts\jupyter-notebook-script.py", line 6, in from notebook.notebookapp import main ModuleNotFoundError: No module named 'notebook.notebookapp'" how to resolve this , i have googled the error and tried the pip install etc.. stil doesnt work

[@geleshgomathil3274]

I run into issues of Conda wasnt working with python=39 and not intsaling ipkernal, resolved BY conda config --remove channels conda-forge conda config --add channels conda-forge conda update conda

[@shmeckles999]

um doesnt tensorflow recommend running wsl 2? that's where I'm stuck on between wanting to use it as OS

[@vinaysagar2321]

I have done everything correct but cannot get success pls someone help me out to connect my gpu to tensorflow, I have checked every enviroment variable one by one every thing is right but still "false"

[@ND15X]

Your content is amazing!!!

[@AegeanEge35]

Hi what makes difference if I dont use anaconda here? I mean what anaconda ensures easily than other because many people in GPU acceleration considering and giving their examples with anaconda

[@soofishafiya72]

I followed the video step by step, everything working fine until last command resulted as FALSE instead of TRUE. I cross checked the commands in cmd but every path is working. And while opening jupyter tensorflow, it is showing an "error occurred while creating a new notebook". What should be done! Please HELP

[@saurabhkadam2063]

I have followed all the steps but at the GPU time its getting me as a false what would be the reason

[@hemantkumardas3333]

Thank you so much sir...

[@karolstylok542]

What do I need to install for tensor cores and what should I install if I want to use LSTM cells?

[@vipinkumaryadav3605]

Thank you, sir. Because of latest version of TensorFlow I struggled a bit. But after using older version it started working. But torch is not able to access GPU any suggestions for torch. Thanks :)

[@DukeOfCurling]

what version of python do you have? mine 2.11 and doesn't work a damn thing. tensorflow is 2.10. I installed the latest cuda which is 2.12 nd the cudnn files but no luck

[@germancruzram]

I have GPU Nvidea 4060TI. What version of cuda would you recommend?

[@qikeshi1219]

Sorry, can I ask why it shows: "C:\Program Files\Microsoft Visual Studio\2022\Community\VC\Auxiliary\Build\vcvars64.bart 'C:\Program' is not recognized as an internal or external command, operable program or batch file." When I can not run vcvars64?

[@productivityacc5128]

If anyone is following this and has a dead kernel when training a model on windows or this msg : Could not load library cudnn_cnn_infer64_8.dll. Error code 126 , you have to install zlib (explained in the nvidia cudnn installation guide)

[@astanalavista]

Perfect guide!!! Nice

[@aspboss1973]

I have RTX 3050, every path checks out. Still its showing False... Please help

[@user-withoutend]

Thanks a lot. I can finally work.

[@DesXboy]

the \include path at min 12:00 is not the one inside CUPTI or is it?

[@jahidtanvir]

Sir, I am getting "kernel appears to have died jupyter notebook" pop-up whenever I try to run model.fit() function. I have installed tensorflow 2.10 following your instruction and official tensorflow pip installation guideline. What should I do? Please Help