156 - How to limit GPU memory usage for TensorFlow?

A very short video to explain the process of assigning GPU memory for TensorFlow calculations.
Code generated in the video can be downloaded from here:
github.com/bns...

[@유나-q6e]

Can you use both Dedicated and Shared GPU memory for tensorflow?

[@nonoyobussiness5828]

This would work if old motherboard's most recent BIOS only supports 1024 mb of VRAM and GPU won't work because it's 2 GB VRAM?

[@abderrahmaneherbadji5478]

Thanks for your efforts

[@AegeanEge35]

Working with 50gb dataset but have got 24GB VRAM GPU gives OOM, can I handle it with such configurations?

[@keiichicom7891]

Hi, no it will just make the gpu under the physical ram limit. If you break your dateset ml training/preprocessing into chunks it might avoid an OOM.

[@keiichicom7891]

I think you might have a rtx 3090 since you mentioned 24gb vram. Can you please tell me how you Cool your GPU?

[@AegeanEge35]

RTX 4090 and it is eGPU so already at outside Im not doing extra cooling thing except for it does

[@LisaSamaritan]

I don't know, for programming. But for games, the reported memory usage in "Task manager", isn't necessary what is used, only what is allocated. You have to use a program like GPU-Z or MSI Afterburner, to see the actual memory usage. Some games are opportunistic, and will reserve all available memory, even if it isn't using it. I guess the same is true, when it comes to programming tools. However, just because it is allocated, doesn't mean that it won't be released for something else, if necessary...

[@asifullah7619]

For 88gb dataset how much GPU required as 2gb is inof

[@DigitalSreeni]

Depends on how much data you want to load at once. I recommend at least 16 GB GPU for good training. Anything lower is good for toy data and for practice purposes.

[@asifullah7619]

@@DigitalSreeni sir i was watch your another video about installation of tensorflow which have 9 steps like (cuda cudn , invidia etc). Sir i am working in tensor flow and taking 28000 images for traninng and code using the cuda commond the hole tarning taking 24 hours according to articles can it run by 2gb graphic card

[@la_kukka]

Thank you. Great Job +

[@selcukmisir2399]

thank you :)

[@DigitalSreeni]

No problem 😊

[@airdoubleone]

don't work with tensorflow v2.5.0 version

[@abdulrahmanmohammed759]

It will be really appreciate it if you can make a video of how to install a GPU

[@DigitalSreeni]

I have a very old GPU so the type of hoops you need to jump through to get it working is not worth sharing. I will have to find a system with newer GPU to go though the process of getting it ready for TensorFlow.