How do Graphics Cards Work? Exploring GPU Architecture

[@BranchEducation]

I (Teddy) went to an engineering college for EE, and a few of my friends went to work for Micron after college and loved it. Check out careers at Micron using this link: bit.ly/micron-careers One question you may have is why did we choose to feature a 3090 Graphics Card? To create an extremely accurate 3D model, we had to purchase the graphics card and do a rather destructive teardown to the extent that we desoldered all the components. In order to not waste a perfectly good graphics card, we typically buy our models as broken or 'for parts' on eBay, and they didn't have any 4090s, so we purchased and used a 3090. For reference, I (Teddy) have a 3090ti in my computer. Also, a 4090 performs 82.58 Trillion calculations a second using 16384 CUDA cores. When it comes to 5090 graphics cards, it looks like they will be 21760 cores, with 32GB GDDR7 memory, and 109.7 Trillion calculations a second, with 170 RT cores and 680 Tensor cores. If you have any questions, feel free to ask them here!

[@Tempestelterna]

No questions. Just keep up the great videos ☺️❤🥸

[@bananaboi3343]

How many people are you working with on these videos

[@kgriffin1032]

I, currently in college for EE, was not aware of Micron before this video, and following the career link to learn that there is a location near me opens up more options for me to explore which I greatly appreciate. Your videos are always so well done and are very impressive. Thank you so much for everything you do!

[@khusburezwan6624]

Please Make a video on how the ai image generator works

[@No_Names_Here]

Excellent content as always 💯. Still hoping to get a video on how Bitcoin mining works.

I am speaking sincerely; This channel does not deserve to be watched for free. It's far beyond the performance of TV channels. It is an excellent detail that such content is available for free on KZbin. Thank you very much. You guys are great.

[@JaxEntersEvasion]

Completely agree, it's insane that we're allowed to watch this just by opening KZbin on our phones or PCs. Mind boggling

[@lindenhoch8396]

Don't worry, you've paid in full with your informations, the preferred KZbin currency.

[@kamakaziozzie3038]

They deserve to get paid- and they are getting paid. Don’t think for a second they are doing any of this content for free.

[@amethyst_academy]

True 100 percent

[@UQRXD]

Good than you pay.

[@KingofArsenal]

This channel is why YT and the internet should exist! It explains the most complex processes in a beautiful presentation that is visually appealing and complex enough with the correct information to explain it. It is insane the amount of details in this video.

[@brodriguez11000]

Wonder if any schools use their videos?

[@Rempi567]

@@brodriguez11000 I do :D

[@idehenebenezer]

​@@brodriguez11000 *Revelation 3:20* Behold, I stand at the door, and knock: if any man hear my voice, and open the door, I will come in to him, and will sup with him, and he with me. HEY THERE 🤗 JESUS IS CALLING YOU TODAY. Turn away from your sins, confess, forsake them and live the victorious life. God bless. Revelation 22:12-14 And, behold, I come quickly; and my reward is with me, to give every man according as his work shall be. I am Alpha and Omega, the beginning and the end, the first and the last. Blessed are they that do his commandments, that they may have right to the tree of life, and may enter in through the gates into the city.

[@lis6502]

Branch Education - one of the very few channels where ad is integral part of the video and is literally unskippable if you want to experience the whole. Amazing

[@saidswn980]

12 600$ whaaat

[@LoggyTheLog]

​@@saidswn980 no

[@Infinx99]

true my friend , true indeed

[@Oliver-bn4yj]

@@saidswn980 only 12,62$

[@idehenebenezer]

​@@saidswn980 To everyone in this chat, I just want to let you know that *Jesus loves you* and he can *save you from sin,* sadness and sickness.

[@ExploringNew1]

It's basically like magic at this point

[@Nacil_54]

That's the best part, it's not, absolutely everything has been thought about and created by humans.

[@habydlg]

We basically tricked a rock into thinking using lightning

[@samsonsoturian6013]

The inability to distinguish between magic and science shows a lack of familiarity with both

[@anzeigefehler6495]

@@samsonsoturian6013 Thats the thing, they might be nearly identicly in function at high enough level

[@Julien-hu4cc]

Welcome to The beauty of science and pc

[@saidswn980]

This channel deserves more this is amazing

[@b1txh]

the animation, the research, and the voiceover just scream quality

[@PenceFamilyGaming]

Every time I watch a branch education video, I am perplexed how these videos are made. Unbelievable talent that constantly makes me say "wow". So much information made easily digestible with the incredible video work.

[@Nate_123]

I am an electrical engineer with extensive computer knowledge and your videos are consistently some of the most accurate and well thought out videos on EE topics out there. I was all ready to say "bitcoin with GPUs, hahaha not since like the early 2000s" but you were already all over it. Love this channel, and great animations and explanations!

[@dangerd9315]

this video is actually insane. so much research and information put into 30 minute video

[@imjody]

Even the sponsored portion is worth watching. 🔥Now that's how things are done. Branch Education is legit absolutely REMARAKBLE. Should have 5 million+ subs easily.

[@laughwithoutsmiling]

This channel is the most severely underrated channels on all of KZbin. Branch Education needs to be on the top pages of all time!

[@AjinkyaMahajan]

Incredibly Detailed Video. Thanks !!!

[@OKAMIKNIGHTS]

The Tensor Matrix is not only what most don't get to see or understand, so I give big props to whoever signed off on including it in the video. As a person who does high-level physics, I appreciated this part the most. I would love a video on the Gravitational field equation, the Schwarzschild equation, and Quark-Gluon dynamics. I understand these, but I would love to see your graphics team attack them.

[@xtrapnation]

Holy crap this video is good, so much useful information that even I didn't know about and amazing editing

[@ShimrraJamaane]

<a href="#" class="seekto" data-time="251">4:11</a> Some NVIDIA GPUs can interface with networks directly via an NVLink Switch, which allows direct GPU-GPU communication within a network. This is how the most powerful supercomputers operate; thousands of GPUs working directly together across 100+Gb links with sub-microsecond latencies, forming one giant meshed GPU.

[@jevonp]

Oh that’s crazy so they’re all hooked up via Ethernet? And 100Gbe exists? Man that’s crazy

[@ShimrraJamaane]

@@jevonp Not ethernet. It uses Infiniband (now owned by NVIDIA), and it goes up to 200Gb. They will release 400Gb in the not too distant future. Infiniband is a competing solution to ethernet/fibre-channel/etc. When I was using it, I was getting 0.3us (300ns) latencies. It's nuts how fast the thing is. p.s. you can run ethernet over infiniband (EoIB) and still get ridiculously high data rates and low latencies.

[@kaidanalenko5222]

I pictured this explanation like when Lain built a PC in anime

[@ado_curt4400]

commenting just for the support because providing such knowledge for free is absolutely incredible, really thanks

[@AlpacaMaster]

I just discovered this channel and I don´t have enough words to describe how impressed I am. This is just another level guys. You´re incredible. So much quality. You deserve the best!

[@Furly700]

In a different world, this wouldn't be free. I feel like it's time I do my part to help keep it free.

[@ExploringNew1]

<a href="#" class="seekto" data-time="961">16:01</a> noted. I'll buy from micron the next time I casually buy an AI accelerator system

[@brodriguez11000]

Something else with repetitive circuitry, and binning.

[@neurotransmi77Er]

you're going to casually wait a few years too.

[@austin-91]

That extremely unplanned huge smile I get when I receive the notification from BE.

[@sushantkumarmishra5538]

wow...! Speechlessly awestruck with the quality of the video... A ton of thanks to the creator 🙏

[@carlosnumbertwo]

My first computer was a Commodore 64. It’s amazing how far we’ve come.

[@derekw7848]

After watching this video and your other videos, I literally have a new perspective on life every time. You've altered my reality over and over again. I hope you get all the support you need.

[@P_L_A_Y]

You are the only channel who does such videos, in such high quality, and most importantly, for free. It's just amazing and I have no words! My favourite channel!

[@saladamista8226]

Branch Education and its contents are of the highest quality. We are privileged to have you here on KZbin! All my gratitude and respect to Branch Education!

[@sushobhan4]

as a cse student learning different ai models, the videos you make really helps in visualizing. thank you once again

[@IDontKnowYou1216]

This is by far the greatest educational channel I have ever seen for technology. I am incredibly blown away at this level of insane detail! This is why I also love KZbin and will be donating to this channel. KZbin in my eyes is now a more reliable learning center than any college out there. I myself used it to pass my CCNA without spending a single dollar which I didn't have at the time, so KZbin saved my chosen career path.

[@vaibhavjain4317]

A suggestion: Instead of the dark sky and tiled plane, just use a black background. It will increase focus, easier for you and more asthetic in my opinion. Your videos are great! Appreciate the effort you put in.

[@tpreethivardhanreddy9218]

The entire team did an amazing job..... Absolutely Marvelous!!!!!!!!!!!!!

[@gesitsinggih]

Man, a lot of computer science professor did not understand this topic. this must have taken a lot of effort, amazing work!

[@bekolor]

This channel surpasses many lectures and videos on KZbin in terms of educational value. Excellent work!

[@Taxodium-d2j]

Another excellent animation episode, thank you! The quality of this channel cannot be overstated. Keep it up, Branch Education!

[@GalaxyHomeA9]

Finally I understood the gpu ga102 architecture visually. Excited and curious to learn more.

[@Maiklerulez]

If this content would be on Netflix. It would be one of the reasons to buy a subscription. Magnificent, marvelous and mind blowing

[@vivienhounsounou1867]

netflix is for entertainment and NOT for education. the bulk of netflix audience will see no value in videos such as these...

[@GadgetsArise]

Whenever you guys upload a video, my excitement level increases at the speed of light! I bet no one in the whole world can explain these complex topics with such beauty!

[@JohnSchley]

This channel perfectly answers the exact question I have had about computers in an in-depth way. not just transistors going on and off.

[@ZackSilver77]

Its impossible for this to have been made any better. Incredible. Truly top notch work

[@AnttiPW]

This channel is an absolute gem.

[@Keepheap]

I think how this video is produced will also be a good content. With respect

[@tommytek_bs]

the visuals of this channel are so well made and so intuitive they can explain complex topics like this while still being relaxing to watch. this should be youtube premium.

[@captain_context9991]

They are using stock footage. This was not made by them.

[@anzeigefehler6495]

@@captain_context9991 care to give prove?

[@juggernaut93]

@@captain_context9991 Wrong.

[@xiaomifan5983]

​@@captain_context9991Wth, have you seen their video about CPU Manufacturing? They did it all by themselves and I know it's a tremendous amount of work because I use CAD Software to Design things and I also Render them, but their Videos are on another level.

[@captain_context9991]

@@xiaomifan5983 Well... I see the graphics are showing a 4 years old Geforce 3090. Instead of the newer model. Which makes me think they are using stock footage. But also this is sponsored by a chip manufacturer. So its also possible they are using their footage.

[@michaelm358]

Teddy, you and the team produce work of the highest quality. Your Outstanding efforts are really appreciated! I discovered your channel only today and signed up as a patron.

[@ikitoki]

My father would LOVE these videos; unfortunately, he does not understand English well, and he does not see well the subtitles. It would be great if these videos had the automatic translation feature of KZbin to listen to you in his language (italian).

[@SolidMartian]

This video is something else. Compared to 90% of KZbin, you’re doing 150% There are channels that go just as in depth as you, but the visualizations are hard to follow for someone not in the know. There are also animation channels that can do better VFX, but combining them in the way that you do is revolutionary! I also loved how deep the sponsor integration was, it makes it feel less like it was just tacked on. Keep up the amazing videos! Maybe you should consider selling uncompressed versions of your videos to download and store privately. I’d love to keep these until KZbin is no more

[@Ozzy_Axil]

They really sacrificed lots of GPU’s just for a youtube video. Hats off guys , True dedication indeed

[@aliawrang9503]

I really appreciate the amount of work this channel puts into explaining these topics

[@adancorderoa]

it's amazing how you can explain something so complex and also to animate it.

[@xophaser]

I had a basic understanding of gpu but this is next level, I watched the other gpu videos from Branch too. top notch, nobody else is even close.

[@dispointor0807]

How many GPU calculation does it take to make this video ?? Absolutely love the video

[@soonts]

Good video but I spotted couple mistakes. Tensor cores do not run geometric transformations, they are only used for AI and DLSS. Most of the time while loading a videogame is not spent moving geometric models, models are typically rather small, most of the VRAM keeps textures. SIMT architecture does not have independent program counters for each lane, they work just like SIMD in that regard; the difference between SIMD and SIMT is the latter runs many threads in addition to many SIMD lanes, and switches to other threads to hide latency of slow instructions like memory loads.

[@nukefalador8891]

Excellent video! The level of detail is very impressive, and you've made it easily digestible with analogies every step of the way. Will certainly be sharing this one. Thanks!

[@ai_outline]

Computer science and engineering majors will love this 🔥

[@martinleopard193]

Showing deserved support! I hope you guys make it to the mainstream as you explain things so well and our modern world is built on the topics you cover. Pure love and respect❤

[@Hubadubbi]

some damn fine animations and extremely well explained and, yet deep video. You guys are doing excellent work. I amamazed!

[@starksuman]

i understood the whole video completely but still humans achieved this in less than half a century is mindblowing

[@CuffyX-v3i]

Excellent! Brilliantly formative. Good work!

[@pedro.alcatra]

Baby, Baby! Wake up! Branch Education dropped another video

[@Sander-y1w]

Absolutely incredible! I actually frequently use this specific graphics card for training neural networks. To see its inner workings is amazing. The past two weeks I have been making an effort to get a better understanding of concepts such as cores, vram, etc. so as to be able to better understand where I can optimize model training and inference, so the timing of this video could not have been better. Thanks a lot!!😃

[@itsrenatoc]

All the information and 3d modeling/presentation you guys do are fascinating!

[@TrevorSullivan]

I just installed my NVIDIA GeForce RTX 4070 Ti SUPER 16GB this past week, and it's crazy fast!! I'm gaming at 4k on a 144hz monitor with unbelievable smoothness!

[@pedro.alcatra]

I also have one. But without DLSS. It is impossible to get this FPS in any modern game. Let alone with Ray tracing. That we see no difference despite in Frame rate

[@Duraltia]

These Videos kinda start to remind of those Vintage ones explaining how a Car Engine, Transmission, Calipers, Soldering, etc... works. Dumbed down enough so everyone interested can understand it _while_ still respecting the Audience - Great stuff... Wish I had this kind of content when I was younger 🤔

[@lawadelante2813]

Thank you for explaining these components of chips and more. One never knows how complex new technology is.

[@AymanAlHafeth]

From the first video I've watched on this channel and I am still recommending it to others. Thanks for the staff who worked so hard for your valuable explanation.

[@toparchitecture]

Yoo this is insane !!! I've learned way more things in this single video than in an entire day of school !! Sooo interesting!!!

[@Riyanpatel-g2y]

Incredibly Detailed Video

[@mutatadaniel]

Wow just wow, this channel is so far the best. It explains most complicated topics. I'm learning ❤❤

[@petermainwaringsx]

I love your videos and watch each one a few times. Every time I see the scale of SSD's, processors ETC, I think it would be easier to believe it all done by magic. I've just posted this one of Facebook. Thanks for your work.

[@SomberDestiny]

Thank you for making this free

[@NizarElZarif]

What a great , simple to understand and accurate video.

[@Billlorde]

Thanks for the vid! Quality of your videos is insane

[@NM0S.]

These videos are beyond exceptional, Thanks a lot for your hardwork. I wish everything was taught like this.

[@silvervortex2441]

Nice(sorry for my bad English)

[@Xetrill]

Usually sponsor integrations aren't great at all. But, kudos to you Branch Education team and Micron as well. You did pretty damn well here. I'd argue (and I think I wouldn't have to) that SP or similar things should not skip the midroll. No, I'd say asking you to do better would be unreasonable territory.

[@Antley278]

the quality of this content is immaculate, GREAT JOB!

[@Qamar92]

This is an exceptional videos that a lot of time spent on researching on the topics, and how to deliver it to an average viewer. p.s : do not skip the ads.

[@theonewhostonks]

I love you guys and your work. Y'all are all super talented, you consistently crank out the highest quality vids on KZbin. Keep going, fellas. Well done.

[@marcglez]

Would like to see more videos like this

[@vitormacedo4144]

As always, amazing and extreme detailed videos. Congrats !!!

[@JackDraak]

There are the best videos on KZbin, no question. Thank you for all the hard work that you put into these productions!

[@rakaorion]

This is just mind-boggling! Awesome animation.

[@bishwashpatel3908]

Whenever they upload a new video I do not stop myself watching that. It is so excited

[@impossible2defy]

One of the best channels on this platform.

[@harshaathavale4101]

this channel is gold!!! will get the recommended micron graphics memory

[@adityajain6733]

i video that i watch more than 3 times and still not get bored

[@aryajpegasus]

this is amazing! I am blown away, thank you so much for this unique invaluable resource!

[@fqed]

These videos are so detailed and good. Thank you.

[@Laima-h4w]

I have read about SIMD and SIMT without having understand it at time. I can express my whole gratitude for your videos. I love gpus and thanks to you i love them eve more and want to love them more. i love you.

[@KeinNiemand]

<a href="#" class="seekto" data-time="824">13:44</a> With CPU using dual channel each channel is 64bit so the total bus width is 128bit.

[@jevonp]

15k recorded views and 5k likes, I can’t tell if views are lagging behind the real Number or you guys have the most insane like ratio! 30% is massive. Hugely deserved, amazing content

[@purvajghude7]

Thank you soo soo much, I used to hate maths before seeing this channel. But after actually seeing how it is applied. I love maths. I wish this channel gets all the funding it needs

[@ReboDavid-x8x]

I love the videos you make they are so realistic and have good graphics. That, together with the fact that this is an educational video about the technology around us is amazing.

[@holeinmysoul1]

how your videos are free i will never know , cause this is more than amazing , its unbelievable

[@Psrj-ad]

such high quality content needs more recognition!

[@jawaharbabuadapa]

Thank u for making these videos available

[@resurec8835]

Explanation: Superb, Animation: Diabolical

[@nerusnotfound]

Sounds interesting, thank you 👍🔥

[@mayankgupta9978]

great video i always watch from start to finish

[@anjansharma8631]

I saw this notif left what I was doing and immediately clicked (it's education time)

[@xzaratulx]

What we can do with electronics by now is simply amazing. I feel that nothing else comes even close in terms of complexity.

[@milky7812]

I am amazed we live in a world where such high quality content can be watched for free by anyone with a simple app.