CUDA Explained - Why Deep Learning uses GPUs

[@deeplizard]

Check out the corresponding blog and other resources for this video at: deeplizard.com/learn/video/6stDhEA0wFQ

[@kudoamv]

So I can't use Computer Vision Programs which require GPU because I am an AMD card user?

[@mae1000]

@@kudoamv Actually, you can, I think. AMD invested in that field too, google "gpuopen".

[@debajyotisg]

Great job speeding Jensen Huang up. xD

[@sudeepkadyan5480]

Can i use 1050ti 4gb for data science

[@faroukmokhtar6900]

Ofcourse

[@atisbasak]

But it will be quite slow.

[@Xiler6969]

Congratulations, You've impressed me. Very professional series. Right to the good stuff, clear and sharp voice, broad yet specific explanations.

[@larryteslaspacexboringlawr739]

5:13 ballmer ambush, panic clicking to skip (thank you for awesome video)

[@deeplizard]

lol. You are welcome!

[@majeedhussain3276]

This channel seriously deserves million subs.Have been watching many series from this channel.Great work !!!!! keep going I'm sure this channel gonna flow with lots of subscribers someday .

[@deeplizard]

Thank you, Majeed! We're glad to hear you've been enjoying multiple series here, and we're happy to have you as an engaged member of the community! Always appreciate seeing your comments :)

[@ajwadakil6020]

This channel should have more subscribers, seriously

[@gabriellugmayr2871]

wow, I saw these first 4 videos of the Pytorch series and am impressed how much time & effort you put into these tutorials. Thanks a lot. Also, you have developed enormously (although the older tutorials were already very good)

[@IgorAherne]

Good overview, also having 8 cores won't necessarily speed up computation by exactly x8, perhaps by x7 in practice I just wish you would mention that processors use SSE2, AVX2 and similar things that allow each core do 8 summations/multiplications/shifts/etc at a time, rather than one by one. This allows a CPU registers to process arrays in chunks of 8. Many C/C++ programmers don't know about those, and build programs that are by default doomed to underperform. So I feel everyone is always unfair towards the CPU. Everybody is pointing at the cores, but each core can (and should) use intrinsics, doing parallel things. Especially with various RNNs where we only win if we move the entire algorithm to the GPU to avoid data transfer bottlenecks, and when the RNN is decently wide in each layer for the GPU. Also, CPU is really flexible when it comes to 'if/else' or while loops, reacting faster and wiry when the branch occurs.

[@deeplizard]

Hey Igor - Thanks for adding these details. Great stuff. Much appreciated! 🙏

[@Sikuq]

Beautifully done, Chris. Wow. Thanks. I learned a lot.

[@MarcelloNesca]

Thank you very much, currently learning deep learning and this was perfect to explain why I need a good GPU

[@chinonsoalumona6734]

Hi Marcello how’s your deep learning experience going?

[@shivangitomar5557]

The BEST VIDEO on this topic!

[@estebansevilla2229]

I ended up here because my daughter is learning "AI" at high school and now I need to understand how this all works to make her a PC.

[@deeplizard]

😅😅

[@SDRIFTERAbdlmounaim]

did you build that pc just fine or you needed further help ?

[@engkamyabi]

Amazing video and loved the short clips! Thank you!

[@Aweheid]

Rich informative video !! No better explanation is more than yours!!

[@bazzinga204]

Beautifully explained.

[@jamesferry8484]

Thank you for sharing. Very helpful.

[@deeplizard]

Hey James - You are welcome!

[@mayur9876]

Thanks for putting in all the efforts.

[@deeplizard]

You are welcome!

[@AdrianDucao]

my girl friend and i been doing a lot of deep learning lately

[@osumanaaa9982]

you sure it's not just shallow computations ? :p

[@q3d385]

@@osumanaaa9982 🤣

[@Aditya_Kumar_12_pass]

I hope you are not hoping for any output.

[@anamitrasingha6362]

@@Aditya_Kumar_12_pass KZbin should have a Haha react xD

[@vibesnovibes6320]

How many layers for protection? Are you clear on how back propogation is supposed to work? 😂😂😂

[@taj-ulislam6902]

Very professional video. Good information.

[@benjaminhansen4808]

You can explain this whole AI trend 5 YEARS AGO

[@Ammothief41]

Any idea on how the rtx graphics cards and their tensor core stuff compares to the standard gtx gpus? Is that something that tensorflow or pytorch take advantage of?

[@deeplizard]

Haven't seen the comparisons. And. Yes. www.geforce.com/hardware/technology/cuda/supported-gpus

[@Not0rious7]

Nice video, I like all the graphics you used. Where do you find them?

[@durafshanjawad5250]

Very Helpful Series

[@Henry..s]

What I learned from this video is that nvidia gpu got their speed from the CEO

[@ajaykrishnan4277]

you just nailed it

[@vky771]

Everyone wishes they saw your video 5 years back 😅

[@anujsaboo7081]

You have a mistake in the quiz section: Q. Different PyTorch components are written in different programming languages. PyTorch is written in all of the following programming languages except? Ans. Java (on blog correct answer is coming as Python)

[@deeplizard]

Hey Anuj - Thank you so much for pointing this out! I've fixed it. You may need to clear your cache to see the change. Chris

[@nozaxi0327]

Thank you. This series so helpful for me

[@deeplizard]

Glad to hear that, jesse! You're welcome!

[@robertatvitalitystar2444]

ty! Peeling the plastic of a brand new GPU is a good day, lol.

[@mexzarkashiev2435]

So which graphics card should I buy for deep learning?

[@jordan5253]

Jesus @2:41 I spit out my water lol

[@SW-ud1wt]

I have HP envy ci7 laptop having GeForce rtx 2050 card, will it be used for machine learning tasks?

[@krishna_o15]

I am agreeing since Soumith has said it.

[@RohanSawant-s3q]

😄very nice video

[@kudoamv]

PLEASE HELP, Is it something like - "you have to download pytorch with cuda if you wanna use gpu or else you will only be able to use cpu" ? I am an AMD user.

[@JasperHatilima]

CUDA is NVIDIA platform and so only supports NVIDIA cards like the GTX GPUs. For AMD, the framework for parallel programming is OpenCL...which unfortunately does not have a development community as big as the CUDA community.

[@ankitaharwal5886]

I can feel your pain 😔 😔

[@henson2k]

When multiple apps are using CUDA how it's managed by GPU? Can GPU execute different kernels at the same time?

[@sqliu9489]

brilliant explanation

[@vibesnovibes6320]

Great video

[@jackt9535]

I'd like to know whether you could use dedicated graphic card for deep learning while you don't have a CPU with no iGPU. This will help me much with my screen cable management issue (I'm new to this) ! Thanks!

[@lancelotxavier9084]

nVidia is holding back processing power in order to make selling their products sustainable.

[@deeplizard]

This is important. A company's incentive to make a profit can be a double-edged-sword. Consider the same problem in healthcare or biotech.

[@henson2k]

@@deeplizard conflict of interests indeed, every software developer knows that LOL

[@faizahmed8034]

Aren't GPU's used for image processing (i.e conversion of binary code to analog Graphic pixels)? If so how can we use them for mathematical computations ?

[@henson2k]

At research stage I can see how Python is acceptable choice. However for production systems Python too large in size and not fast enough!

[@qusayhamad7243]

thank you

[@rifatmasud]

Anyone have that video link regarding "python is slow"?

[@deeplizard]

Added it to the description. Here you go: kzbin.info/www/bejne/enO5fZadppd4nZI

[@arkamitra4345]

GIL is evil 😓

[@TheTariqibnziyad]

Finally these nerds got the guts to call something a funny name, Embarrassingly parallel xD

[@deeplizard]

🤓

[@zackrider3708]

@@deeplizard can the new XE server gpu from intel handle ai or Deep Learning workloads like nvidia gpu ?

[@True38]

Did they remove all those stats/functions on a newer version of Cudo? Because I just recently downloaded it, and the only thing I can see on the screen is CPU, XMRig, h/s to the left and Payout Coin to the right. That's it! I'm using CPU but want to use GPU, but can't see any option. Please help if you can.

[@ezevictor4448]

Is a gtx 960m or 1050m worth using?

[@_SupremeKing]

Although still being confused, I just picked up some new knowledge for a layman like me

[@zeppybrawlstars3906]

So when I play games with advance Ai make sure my gpu is ready

[@deeplizard]

Exactly. 🤖

[@magelauditore333]

5:25 i was like wtf. Can anyone have the link of whole video. 😂😂. Man i got excited and started shouting at home

[@deeplizard]

It's a popular one. Google and you will find 😂

[@MMphego]

Subscribed.............

[@Priya_dancelover]

excellent

[@e4r281]

Maybe if we start telling people the brain is an app they will start using it.

[@clbl8706]

That's some cringeworthy joke my grandma would share on FB.

[@e4r281]

@@clbl8706 actually, it's not a joke.

[@nikhilmathur3351]

@@e4r281 Unlike you

[@hailongvan8285]

ok commie

[@isbestlizard]

OH MY GOD WOW are you a lizard too? i love ai and stuff as well :D

[@deeplizard]

🤣

[@alkeryn1700]

Guys, don't use cuda, use HIP so it runs everywhere or use opencl or sycl but don't have your software stuck to proprietary and platform specific hardware and software

[@A-Predator]

i just learned the name of deep learning 😵

[@adithi729]

Sir is there any way to do cuda programing online? i mean any online compiler is present now? my system is not supporting cuda..pls help

[@dalirkosimov4623]

You can do it on jupyter

[@sajolsajol8393]

wow!

[@kanui3618]

Can I combine Nvidia GTX 1070 or higher with amd ryzen 5

[@deeplizard]

no amd at the moment.

[@richarda1630]

exciting and if you read WBW blog thrilling times

[@hedonismbot1508]

Never in my lifetime would I have ever imagined "Embarrassingly [something]" would be an actual technical term.

[@deeplizard]

😅😅

[@louerleseigneur4532]

merci merci

[@SuperMIKevin]

Lmao, I can't believe they actually named it embarrassingly parallel.

[@pscheuerling]

I came Here to learn how to utilitise deep learning cores for Training my own ai... I still don't know why i should buy cores i cant use.

[@A-Predator]

😵

[@lakeguy65616]

the forward pass can rely on matrix math which can be run through CUDA(software layer) and done on an NVIDIA GPU. The more GPU cores, the faster the process. A gpu with 100 cores will perform this step 10x faster than a GPU with 10 cores (in general...).

[@beomheelee1249]

you're so geinus!! Thanks

[@invest8198]

someone who bought $NVDA 2018 ?

[@alebecker12]

I have a doubt, does Nvidia has a monopoly in such hardware? If not, does CUDA only work on Nvidia hardware?

[@deeplizard]

Yes. Nvidia built CUDA. It only works with their hardware.

[@avdhutjadhav5657]

Does that mean GPU with more CUDA is better for Deep learning ?

[@lakeguy65616]

yes (and more gpu ram...)

[@DinoFancellu]

Its a pity that AMD don't seem to support CUDA. Their new big navi cars look really nice apart from that

[@Infinityxx3]

u need some music in vid... attracks views.... cool vid

[@deeplizard]

What kind of music do you like?

[@Infinityxx3]

​@@deeplizard PEWDIEPIE bitch lasanga ? jk... any relaxing music when u talk... when u changing camera shot etc... ;)

[@deeplizard]

haha. That sent us on a tangent. Hadn't seen that before.🤣

[@MilesBellas]

Jensen is better at 2x

[@yourgflikesit]

Steve Balmer off his face again lol

[@robertsmith512]

SUBBED ! EVERYBODY SUB THIS CHAN ! THIS ONE KNOWS HE'S STUFF ! GO LOOK AT THE PLAYLIST LIB !

[@deeplizard]

Thanks Robert! Note that there are two of us here. 🦎🦎

[@cubul32]

Former CEO - and we can see why.

[@deeplizard]

Although, he became a billionaire from his tenure at Microsoft 😄

[@jacobcorr337]

CUDA not explained at all

[@lakeguy65616]

CUDA is a software layer that interfaces with Nvidia GPUS to allow porting some problems (think forward pass) to the GPU which can be done in parallel. (your pc has an Nvidia GPU, with software like Pytorch, you tell PC cuda is available and to send certain processes to GPU for processing in parallel.) vastly over simplified.

[@MeowsyDancer]

I will now send this to anyone who asked why I bought a 3090! rip wallet tho

[@deeplizard]

🤣💰

[@iLevelTechnology]

He doesn’t explain tensor very well but overall good job

[@Joco5012]

Wow was it this ok to do so much coke back in the day? 5:12 damn dude take it down a notch

[@ErrorRaffyline0]

I really dislike CUDA becouse it’s not open-source and AMD is not able to use it, it makes development for both AMD and NVIDIA much harder.

[@liangwei4869]

5:57 東工大でるのは草www

[@Drtsaga]

"Deep learning" should not be on the title in my opinion.

[@escapefelicity2913]

I'm glad I don't need to listen to Jensen Huang.

[@mmm-ie5ws]

u did a rly bad job at explaining why gpu's are better for parrallel computing than cpu's.