How do Graphics Cards Work? Exploring GPU Architecture

[@BranchEducation]

I (Teddy) went to an engineering college for Electrical Engineering, and a few of my friends went to work for Micron after college and loved it. Check out careers at Micron using this link: bit.ly/micron-careers One question you may have is why did we choose to feature a 3090 Graphics Card? To create an extremely accurate 3D model, we had to purchase the graphics card and do a rather destructive teardown to the extent that we desoldered all the components. To avoid wasting a perfectly good graphics card, we typically buy our models as broken or 'for parts' on eBay, and they didn't have any 4090s, so we purchased and used a 3090. Just so you know, I (Teddy) have a 3090ti in my computer, an i9-12900k, 64GB ram and a bunch of SSDs. Also, a 4090 performs 82.58 Trillion calculations a second using 16384 CUDA cores. When it comes to 5090 graphics cards, it looks like they will be 21760 cores, with 32GB GDDR7 memory, and 109.7 Trillion calculations a second, with 170 RT cores and 680 Tensor cores. If you have any questions, feel free to ask them here!

[@Tempestelterna]

No questions. Just keep up the great videos ☺️❤🥸

[@bananaboi3343]

How many people are you working with on these videos

[@kgriffin1032]

I, currently in college for EE, was not aware of Micron before this video, and following the career link to learn that there is a location near me opens up more options for me to explore which I greatly appreciate. Your videos are always so well done and are very impressive. Thank you so much for everything you do!

[@khusburezwan6624]

Please Make a video on how the ai image generator works

[@No_Names_Here]

Excellent content as always 💯. Still hoping to get a video on how Bitcoin mining works.

I am speaking sincerely; This channel does not deserve to be watched for free. It's far beyond the performance of TV channels. It is an excellent detail that such content is available for free on KZbin. Thank you very much. You guys are great.

[@LeeChaosin]

Completely agree, it's insane that we're allowed to watch this just by opening KZbin on our phones or PCs. Mind boggling

[@lindenhoch8396]

Don't worry, you've paid in full with your informations, the preferred KZbin currency.

[@kamakaziozzie3038]

They deserve to get paid- and they are getting paid. Don’t think for a second they are doing any of this content for free.

[@al-ihsan-institute]

True 100 percent

[@UQRXD]

Good than you pay.

[@KingofArsenal]

This channel is why YT and the internet should exist! It explains the most complex processes in a beautiful presentation that is visually appealing and complex enough with the correct information to explain it. It is insane the amount of details in this video.

[@brodriguez11000]

Wonder if any schools use their videos?

[@Rempi567]

@@brodriguez11000 I do :D

[@JesusPlsSaveMe]

​@@brodriguez11000 *Revelation 3:20* Behold, I stand at the door, and knock: if any man hear my voice, and open the door, I will come in to him, and will sup with him, and he with me. HEY THERE 🤗 JESUS IS CALLING YOU TODAY. Turn away from your sins, confess, forsake them and live the victorious life. God bless. Revelation 22:12-14 And, behold, I come quickly; and my reward is with me, to give every man according as his work shall be. I am Alpha and Omega, the beginning and the end, the first and the last. Blessed are they that do his commandments, that they may have right to the tree of life, and may enter in through the gates into the city.

[@lawrencefrost9063]

..for free, at any time anywhere.

[@Gman2002]

Reminds me of the old PS3 cell processor commercials.

[@der.Schtefan]

I am an engineer, and the level of detail, and animations like showing the eye diagram from the ternary encoding, drive tears of joy into my eyes. Thank you so much!

[@zeyadsalim]

Same man

[@jcgdijkstra]

I hear you. 60 year old electronics engineer here that built his own 8-bit microprocessor systems back in the day. We've sure come a long way 👍!

[@Sr.DeathKnight]

EE too, and I was like: WOW!

[@n8blank]

NO BS, STRAIGHT FACTS, PURE KNOWLEDGE, INCREDIBLE ANIMATIONS, CRYSTAL CLEAR AUDIO. THIS IS PEAK EDUCATION!!

[@ExploringNew1]

It's basically like magic at this point

[@Nacil_54]

That's the best part, it's not, absolutely everything has been thought about and created by humans.

[@habydlg]

We basically tricked a rock into thinking using lightning

[@samsonsoturian6013]

The inability to distinguish between magic and science shows a lack of familiarity with both

[@anzeigefehler6495]

@@samsonsoturian6013 Thats the thing, they might be nearly identicly in function at high enough level

[@Julien-hu4cc]

Welcome to The beauty of science and pc

[@b1txh]

the animation, the research, and the voiceover just scream quality

[@Words-.]

👀

[@locinolacolino1302]

@@Words-. It's in Indonesian currency

[@CesarMartinez-wi7wc]

​@@locinolacolino1302 It's about a $1.30

[@le-bin]

@@CesarMartinez-wi7wc lol

[@dilanrajapaksha]

damn bro how's the indonesian economy doing? got some inflation going on or something?

[@Jem-Holograms]

I'm taking a computer architecture class this semester, and I’m so excited to have found your video! Some concepts in computer architecture are hard to grasp just from reading a textbook. Your video made everything so much clearer and helped me score a 91 on my midterm. Thank you!

[@Mr.DMZ.]

I took a comp arch class for my bachelors. It's insanely complicated

[@1SmokedTurkey1]

We had to study comp arch as part of my bachelor's of electrical engineering. Most difficult subject I've encountered in all my years at uni. Good luck

[@emilcost8613]

I promise you that you are looking at a career that will fascinate you every day. I spent my 40 years working with brilliant people, and each day was incredibly rewarding working with such people. I wish you 40 years of intense excitement and fun, honing your craft. You are making the right choice.

[@icemangtr1]

what speciallity you are into in?

[@santanawilian]

I’ve said this before, and I’ll say it again: this channel is a beacon of light in today’s world. You all make me feel like the 5-year-old version of myself from the 90s, dreaming of becoming a scientist and working at the forefront of technology. Although I have become a physician, I have never lost my amazement for technology. I’m so glad to have followed your work for several years now. Once again, thank you so much for your effort in producing this incredible content!

[@shashannkaggarwal8139]

It is strange feeling to see this video floating around on YT with others that are far less informative and of lesser quality. I am grateful for this.

[@Swag_Massiah14]

why the fuck would you spent 500 dollars just to make your comment stand out

[@chainsawman-hell666]

Facts sir this video is so informative

[@Maiklerulez]

If this content would be on Netflix. It would be one of the reasons to buy a subscription. Magnificent, marvelous and mind blowing

[@vivienhounsounou1867]

netflix is for entertainment and NOT for education. the bulk of netflix audience will see no value in videos such as these...

[@swipsi6858]

@@vivienhounsounou1867 thats just not true lol. Netflix has plenty of plenty of documentations, from technology over medicine, diet, nature, physics, psychology you name it. And they are much like by the users.

[@allamasadi7970]

​@@vivienhounsounou1867I think you're right, us watching Branch Education are in a small minority

[@mannyhappening]

This should never make it to Netflix else it would be ruined as well. Netflix does not deserve this level of quality.

[@johnnyr1co695]

..and that is why I only pay for KZbin susscription.

[@lis6502]

Branch Education - one of the very few channels where ad is integral part of the video and is literally unskippable if you want to experience the whole. Amazing

[@saidswn980]

12 600$ whaaat

[@LoggyTheLog]

​@@saidswn980 no

[@Infinx99]

true my friend , true indeed

[@Oliver-bn4yj]

@@saidswn980 only 12,62$

[@JesusPlsSaveMe]

​@@saidswn980 To everyone in this chat, I just want to let you know that *Jesus loves you* and he can *save you from sin,* sadness and sickness.

[@RedShiftMusic]

Phenomenal video as always. Thank you for making this accessible to all. Love your animation style which is an art in itself. Videos like this take an insane amount of time and intellect to make. I'm honored to be part of this community!

[@ravager209]

I work in the Medical Devices industry so not necessarily my field. But these videos are so high quality, so well researched and informative, I genuinely cannot believe I get to watch such quality for free.

[@jannikheidemann3805]

Graphics cards are already for decades being used to draw the immages we get out of 3D imaging procedures such as MRI from the raw data the sensors of these machines collect from the specimen.

[@eXecu7e]

It's funny to think that this video may already help TPUs better understand themselves.

[@BranchEducation]

Thank you so much!! Eventually we'll make a video on TPUs, but that'll be harder cuz, well, understanding tensors and massive matrices isn't all that intuitive.

[@voltsp288]

Damn mate

[@jcgdijkstra]

There's reinforced learning for ya! Hell of a feedback 😄

[@olbapablo2615]

HOW THIS COMMENT ONLY HAS 3 REPLIES?????

[@tanboomc]

W

[@JoseeHanma]

Its insane how we can watch videos with such amazing graphics and thorough information for free.

[@XenoghostTV]

You realize the organization behind this project doesn't really have financial difficulties right? 😭 Edit: it is literally stated in the video at 2:08 that they're sponsored by Micron, the money is yours but you're outright wasting it

[@BloodRaven1045]

This channel is a gift to this platform. No BS, no annoying thumbnails, the voiceover isn’t annoying, it’s actually relaxing.

[@Furly700]

In a different world, this wouldn't be free. I feel like it's time I do my part to help keep it free.

[@Christiaan-qj8fi]

🐐🐐

[@a840w]

Absolute legend

[@wedusk]

Keep 'em coming! Update: I didn't even start watching the video when when I made the small donation because I knew how good it would be. And I'm happy to say that your channel has exceeded my expectations again. Once again, I will be using your content to introduce new comers to the field. As a professional, in this exact field, I'm overjoyed to know that there is a channel like yours spreading the passion I have for this highly technical but often misunderstood domain. Hats off to your entire team 🙌

[@CoconutChor]

Kya job karte ho bhai

[@iamAbheesh]

Bhai aapke shaadi me bhulao

[@rubenpfleger4221]

Same, first like and then enjoy the video

[@JmKrokY]

Nice

[@HafidLazuardi-sy8ft]

small donation

[@maverick9708]

wow, the amount of information you needed to digest to simplify in such a way is breathtaking. feels like it condensed 35+ years of technical and science education into a brief 20 minute presentation for people who aren't into this can digest

[@attack125]

almost like an AI from the future is trying to teach the masses before it's too late.

[@adammiller161]

The most amazing part of this video is the production value. Every one of these is feature film length documentary worthy and they never, ever miss

[@guyedwards22]

I believe in the goodness, utility, and craft of what you're doing with this channel. I don't have a lot of money to throw around necessarily, but this sort of content is what the world really needs. Your voice reminds me of the Codex Entries from the Mass Effect series. Very fitting for delivering the lore of our own universe ❤

[@Mdfan3071]

Bro donated 100 dollers and got no response 😭🙏#respectforbro

[@masonfurlow1453]

@@Mdfan3071he sold

[@lanceh90]

Thats a very generous donation. I am also moved and in agreement with your words. P.S Mass Effect is one of the best video games series ever made - highly recommend for anyone who has missed out on this incredible world.

[@low-key-gamer6117]

you donated $100 for an AI text to voice

[@johnstearman769]

Keep your money bro KZbin would be paying them well

[@saidswn980]

This channel deserves more this is amazing

[@tbird-z1r]

Voted down for saying Cyberpunk was realistic. It's a terrible game.

[@laughwithoutsmiling]

This channel is the most severely underrated channels on all of KZbin. Branch Education needs to be on the top pages of all time!

[@TheLordstrider]

best animated + narrated video about gpu i have ever seen. well done.

[@HaribabuPasupathy]

Thanks! a lot of information with a visual way of teaching is outstanding. please make more technical videos like this. All the best and thanks again.

[@dangerd9315]

this video is actually insane. so much research and information put into 30 minute video

[@james_pre]

This is some of the highest quality and most informative content I've found. Thank you all so much for making this amazing content!

[@comet3429]

Everything , from the 3D models of the graphics cards to the animation till the explaination , everything is perfect. Loved the video!

[@Destrio_Fury]

This video just explained the GPU architecture in most convenient way and visuals, which I have accumulated begging GPT for 3 days in terms of text.

[@Mdfan3071]

Bro donateed five hundred dollers for 70 likes😭🙏#respectforbro

[@aviraldixit7643]

​@@Mdfan3071 Dollars?

[@low-key-gamer6117]

this video IS chatgpt

[@OmarFaruk-i9]

It's rupees(Indian currency). Not dollars. It's about 6 usd​@@Mdfan3071

[@naturecraft5069]

@@Mdfan3071These aren’t 500$ these are Indian Rupie and 500 of them are around 6$

[@plumberman19]

The effort here is just incredible! I have learned so much and have gained valuable knowledge and perspective about some of my favorite things in this world. Please keep up this amazing work! Thanks BE

[@Nate_123]

I am an electrical engineer with extensive computer knowledge and your videos are consistently some of the most accurate and well thought out videos on EE topics out there. I was all ready to say "bitcoin with GPUs, hahaha not since like the early 2000s" but you were already all over it. Love this channel, and great animations and explanations!

[@Truemann45]

As a slightly better and more credentialed electrical engineer I can confidently debunk this comment. It's wrong and gay

[@ponponpatapon9670]

@@Truemann45 ur mom

[@heinrichagrippa5681]

Bitcoin didn't exist in the early '00s. It began in 2009, and for a quite a while _CPU_ mining was still viable. By 2012 GPU mining had replaced it, and while ASICS were overtaking them, GPUs wouldn't be entirely irrelevant until some years later.

[@joeljohnjacob6246]

I am an electrical engineering student, and i am also interested in computer architecture. This channel is soooo good.

[@akaHarvesteR]

I love the spoon Vs excavator analogy. And I'm happy mining has moved on from GPUs, so we can finally have them for gaming again! 🫠

[@zenobikraweznick]

The quality of this is exceptional, wow.

[@DiamondCartierSkeleton]

It’s absolutelly lovelly how much details you put in to video. And it’s even more mind blowing how can human brain create a such thing like that!

[@AnkitGaur9]

This is a very detailed explanation of GPU architecture

[@StingofaSingh]

I love the intense detail on matching the animation to what the narrator is saying. There are so many subtle details in the animation that really enhance the learning and visual communication. It's stunning, new favourite KZbin channel!

[@fernandodutra3788]

This is simply gold. Such professional animations with rigorous yet accessible technical depth

[@portobellomushroom5764]

This is quite possibly the most clear, thorough, and understandable explanation of a GPU I have ever seen. The visuals are incredibly beautiful and accurate. The ad was more interested in recruiting me to work for Micron than trying to sell me their products (which I find hilarious). And your voice is quite soothing. Incredible video

[@lucasrem]

Made for noobs, the basics for people that don't understand it...

[@zeph3070]

@@lucasrem 1/10 rage bait. Vast majority of electrical engineering, IT, cybersecurity, and pretty much whoever else do not know what a giga thread engine is. This is made for intermediate. Where do you work and/or where do you get most of your information?

[@3SBK89]

This is the best channel of this kind on KZbin. Amazing video!

[@jgf4224]

Getting sponsored by a semiconductor manufacturing company giving internship opportunities has got to be the biggest power move in yt sponsorship game ever

[@jaegerschutt4635]

Amazing content, thank you all for the work you do to create these videos!

[@kuldeep77x]

This is truly facsinating. Thank you Branch Education.

[@santanubapari]

OMG ! OMG ! OMG ! This is some OSCAR level editing and explanation, Thanks for this 28 minutes and 29 seconds of EPIC .

[@gallium-gonzollium]

Your videos are nothing short of miraculous. Unravelling such intricacies of technology with these 3d animations make even the most complex concepts feel within reach. You are acing it!! This level of effort and insight shouldn't be free - you’re offering a masterclass in education, for free, for all to watch. Consider yourself part of the gods that make up all the explainers on KZbin. You deserve it.

[@lucianooliveira5940]

I'm amazed by the quality of this video. Unbelievable craftsmanship. Beautifully done.

[@Itsmarkyoung]

The cargo ship/airplane analogy was insanely good, especially with the visuals. No videos have made me understand how electronics and computers work better than yours. Outstanding!!

[@JohnSchley]

This channel perfectly answers the exact question I have had about computers in an in-depth way. not just transistors going on and off.

[@mast3rbug]

As a professional involved in electronic circuit design and advanced embedded systems programming, I possess extensive knowledge across a wide range of systems. However, I must express my deep admiration for the quality and depth of your channel. It continually impresses me, and I find myself learning about concepts I was previously unaware of. I can't even begin to imagine the amount of work required to produce these videos. Thank you for this and all of your other videos.

[@gmgxcnn2574]

Just mind-blowing. The efforts and research put in this video is so good, that I couldn't have a mind to skip the sponsor. I found your channel first time and became a fan of your in just this one video. Mind-blowing 🤯.

[@danr.1299]

The level of production this channel does is insane. I can't imagine how much time and effort they put into these animations let alone the research required to explain something of this complexity.

[@Markthegreat6789]

Thank you Micron for sponsoring the channel to make this video. It was incredibly fascinating!

[@arkapravamanna]

Your videos are so detailed and perfect. They give us a lot of knowledge and as a digital design engineer myself, I am always fascinated by your videos and respect your work a lot. Thanks for making such amazing videos for free.

[@avramukk]

Wow, this breakdown of GPU architecture is mind-blowing! The level of detail about the GA102 and memory tech like GDDR6X and GDDR7 is exactly what I was looking for. More content diving into cutting-edge GPU tech, AI memory, or even HBM3E would be amazing! Keep it coming! 👏

[@ShimrraJamaane]

<a href="#" class="seekto" data-time="251">4:11</a> Some NVIDIA GPUs can interface with networks directly via an NVLink Switch, which allows direct GPU-GPU communication within a network. This is how the most powerful supercomputers operate; thousands of GPUs working directly together across 100+Gb links with sub-microsecond latencies, forming one giant meshed GPU.

[@jevonp]

Oh that’s crazy so they’re all hooked up via Ethernet? And 100Gbe exists? Man that’s crazy

[@ShimrraJamaane]

@@jevonp Not ethernet. It uses Infiniband (now owned by NVIDIA), and it goes up to 200Gb. They will release 400Gb in the not too distant future. Infiniband is a competing solution to ethernet/fibre-channel/etc. When I was using it, I was getting 0.3us (300ns) latencies. It's nuts how fast the thing is. p.s. you can run ethernet over infiniband (EoIB) and still get ridiculously high data rates and low latencies.

[@kaidanalenko5222]

I pictured this explanation like when Lain built a PC in anime

[@game-tea]

​@@jevonp800GbE has been commercially available for a year or so by now, although it's mostly used for uplinks in massive datacenter switches since a PCIe gen 5 x16 slot can't even carry that much data. Things are moving fast right now, hell PCIe gen 7 already has functional prototype chips.

[@andreas1132]

Someone also made a pixel shader that could run the linux kernel in the game vr chat. Definitely possible to run an OS in a GPU if you try hard enough. Not recommended though :)

[@batee5stream887]

this is the most informative video i've ever seen about this topic in forever, thank you for your hard work, very much appreciated and please keep going

[@sherifbatawy]

صح فعلاً 🇪🇬🇪🇬

[@ahmetekrem7704]

Another great video, I'm looking forward to the video where you explain the CPU architecture. :)

[@folk_the_animator]

They already did.

[@freestylerveevo]

​link

[@escher4401]

@@folk_the_animator Are you sure? This video is from 10h ago and it's explicitly said that they're planning the video (4:50)

[@daniel-ez1pv]

@@folk_the_animator They didnt , they have a video about how cpus ares madre, but not how they works.

[@folk_the_animator]

@@daniel-ez1pv Oh yh.

[@JelleCraftYT]

Thxx for making another great video, I'm currently making a project for school on how computers works and you vids are a great help. i have watched your DRAM video atleast 6 times already. You make it easy to understand diffecult topics. keep up the great work.

[@trickm0nkey]

I have to throw money at this please continue

[@trickm0nkey]

@MahmoudRoshdy0no.

[@EJD339]

By far the best video for this topic as someone who wants to learn more but doesn’t know anything. The animations make this so much easier to understand.

[@imjody]

Even the sponsored portion is worth watching. 🔥Now that's how things are done. Branch Education is legit absolutely REMARAKBLE. Should have 5 million+ subs easily.

[@jeetgc26]

Just randomly ran into this channel tonight and loved the content so much that this is the first time I've actually paused the video to like, comment, & subscribe when the video asked me to. Wow, stellar project & this is something I've had on my to-do list to learn and research about independently but finding this neat little 30 minute video with all the research done and presented in such a pristine way... definitely will be considering the annual subscription. 🍻

[@kannan1454]

Thank you so much your videos are so informative and i learned a lot from your videos, nobody really makes these types of videos and you're doing it for free and educating people

[@SyPhEnOG]

As an IT Professional for over 40 years, I must say that this is amazing detail. This benefits me in my career as an escalations engineer. I have a wide skillset for troubleshooting, but did not get into that level of detail on how the hardware functions. In my role, I have to be familiar with various technologies within IT. So, you can teach and old dog new tricks. Amazing work! I feel this will only benefit me and will be rewatching a few times. I also plan to share your work with our Level 1 team. Keep putting out the hits!

[@DaRazee]

The quality put into this is insane! I feel so guilty watching this for free. I could not afford to watch if it was not for free either. Bless the people behind this amazing works.

[@puffy_btw]

Super interesting video. I love it when stuff is explained so detailed and with graphical examples like this

[@jayunlee9100]

I'm a computer science and engineering major student in my third grade. I've just finished computer architecture course that deals with basic CPU design and instruction set architecture, cache etc. I thought I'de done a good job with that course. Then the professor suddenly recommended me a paper about CUDA and GPU etc and I was freakin lost. This video helped me a lot with understanding the basics of GPU thx.

[@hucancode9]

Very well explained!

[@derekw7848]

After watching this video and your other videos, I literally have a new perspective on life every time. You've altered my reality over and over again. I hope you get all the support you need.

[@RickOShay]

Excellent video! Great depth and quality of information. Making the very complex relatively easy to understand is a real skill. Well done.

[@jessechristman1471]

This content deserves more than respect

[@Lokonarua]

The first video i watched was "how speakers work", and it was such a great video that i instantly fell in love with the chanel. But these last ones, HOLY SHIT! Its astounding how far this channel has come, and truly amazing that we live in a time where this information is available to everyone for free.

[@DmitryBabanov]

this is such an incredible level of production!

[@periklisprovidis1000]

Wonderful job! This video held my attention for 28 minutes and 29 seconds straight without a moment of boredom. This is truly excellent work from you all. Keep it up!

[@muhammadfaizanyousuf6492]

You earned this like and comment. It is one thing to understand complex calculations in gpus and another thing to understand the complexity of the video itself. This is precious. Please continue.

[@PenceFamilyGaming]

Every time I watch a branch education video, I am perplexed how these videos are made. Unbelievable talent that constantly makes me say "wow". So much information made easily digestible with the incredible video work.

[@Luznaturalny1]

They must have a secret super AI synthesising all the information 😂

[@justindawson3634]

Incredible quality. Thank you

[@paulmillard9942]

Amazing video, beautifully put together, computers now doing trillions of calculation per second, just can’t get my head around that!

[@dawoodabdullah4661]

the amount of effort the GPU of this animation maker had went through.... truly amazing

[@proton3748]

I am sure they have a team so GPUs it is

[@mjthebest7294]

I never saw a video with such extremely insane animation quality plus sound design. Holy heck, are you serious? Congratulations. Gave me goosebumps.

[@OliverHartwig]

I'm delighted to have found this channel; it does an incredible job combining informative content with entertainment. The animation is not only visually pleasing but also helps to grasp the structure of the graphics cards. I also like the high information depth while its still being relatively easy to follow. The computer memory video goes well with this. And nice to see such a recent video already with Micron's new logo.

[@user-hamidos]

I hope you will continue and do not rush to upload the videos because we need time to replay the video several times in order for it to be understood and ingrained in our minds. What is important is mastery, simplification, and clarification with audio and video. Thank you all

[@chrischauhan1649]

Really, what a time to be alive, such a high quality content for free. Kudos to all the people how are behind this channel.

[@AjinkyaMahajan]

Incredibly Detailed Video. Thanks !!!

[@S1nGuLariTY_]

It feels illegal to watch this free so here. It’s not much but better than nothing.

[@nathanndruwin1782]

It just warms my heart to see how much a lot of people like you appreciate their work. Thank you. I wish I could do the same 😢

[@S1nGuLariTY_]

@@nathanndruwin1782 🫶🫶

[@dvbanana]

These videos have answered so many questions I've had and they're free which is just amazing and you 100% deserve the subscribers you have And Have actually helped me with a couple of projects I have so please keep making these videos because I really enjoy them and also because you are educating a lot of people and may actually Be helping teach the next generation Of the tech industry Seriously These videos are about the only way to learn this stuff

[@Taxodium-d2j]

Another excellent animation episode, thank you! The quality of this channel cannot be overstated. Keep it up, Branch Education!

[@austin-91]

That extremely unplanned huge smile I get when I receive the notification from BE.

[@soonts]

Good video but I spotted couple mistakes. Tensor cores do not run geometric transformations, they are only used for AI and DLSS. Most of the time while loading a videogame is not spent moving geometric models, models are typically rather small, most of the VRAM keeps textures. SIMT architecture does not have independent program counters for each lane, they work just like SIMD in that regard; the difference between SIMD and SIMT is the latter runs many threads in addition to many SIMD lanes, and switches to other threads to hide latency of slow instructions like memory loads.

[@Ele20002]

Extra notes: Tensor cores can still be used by developers for general purpose matmul using VK_NV_cooperative_matrix. You're correct about switching out warps to hide memory latency, but the Volta architecture whitepaper indicates newer GPUs do indeed have program counters for each lane allowing potentially all threads to diverge. But the execution units can still only execute at a single PC at a time, so switches between the thread groups. This may help to ensure work can still be done while one branch is waiting, but it seems like a big part is reducing deadlocks between divergent threads in cuda programs.

[@cinderwolf32]

Why are the tensor cores not used for geometric transformations? This seems counter intuitive, with transformation matrices being what they are.

[@soonts]

@@cinderwolf32 Tensor cores are completely useless for geometric transformations for two reasons. Input vertex coordinates and transformation matrices need FP32 precision, while tensor cores only support low-precision inputs: FP16, BF16, int8, also weird TF32 format which uses 19 bits per number. They support FP32 accumulators, but not inputs. Secondly, tensor cores operate at warp-level, which means 32 CUDA threads are collectively computing relatively large tile of a matrix, like 16×16 or 8×32 elements at once. Vertex transformations only need 4×4 matrices.

[@PaulHeffner]

This video is a wild mental ride. Absorbing the sheer volume of detailed information is like trying to drink from a firehose! The graphics are beautiful (as would be expected given the subject). The pacing is abrupt but understandable. Great stuff!

[@xtrapnation]

Holy crap this video is good, so much useful information that even I didn't know about and amazing editing

[@OKAMIKNIGHTS]

The Tensor Matrix is not only what most don't get to see or understand, so I give big props to whoever signed off on including it in the video. As a person who does high-level physics, I appreciated this part the most. I would love a video on the Gravitational field equation, the Schwarzschild equation, and Quark-Gluon dynamics. I understand these, but I would love to see your graphics team attack them.

[@starksuman]

i understood the whole video completely but still humans achieved this in less than half a century is mindblowing

[@AlokLein]

Its because We are improving technology in parallel😄

[@lowlife4x424]

aliens

[@Words-.]

@@AlokLein This is the key ain't it. Different fronts advancing at the same time and the benefits slowly blending together.

[@starksuman]

@@AlokLein if we can just avoid wars and conflict then humans can achieve great hight in the next half century. It's us who stopping ourselves to grow.

[@watson1212]

thanks to men who discover STEM subjects otherwise we don't even get a phone to watch this😅 still brainrot women say they needs equality butwhat they done to humankind technologies? 😂

[@puffy_btw]

it's the first video i've seen of you guys and i allready know that im gonna love this channel

[@persiaable]

A channel which is more than worth to be supported! Thanks and greeting from Germany

[@OpreanMircea]

<a href="#" class="seekto" data-time="1430">23:50</a> ask me to like, you don't even need to

[@johnhawkins3577]

Same here! I liked and subscribed within 2 minutes of watching!

[@ExploringNew1]

<a href="#" class="seekto" data-time="961">16:01</a> noted. I'll buy from micron the next time I casually buy an AI accelerator system

[@brodriguez11000]

Something else with repetitive circuitry, and binning.

[@neurotransmi77Er]

you're going to casually wait a few years too.

[@01Deegee]

Outrageously high quality video. Well done

[@Iamtoogod]

<a href="#" class="seekto" data-time="960">16:00</a> "Next time you buy an AI accelerator system" Me checks wallet:😐

[@Iamtoogod]

In all seriousness these videos are incredible! Its crazy that it is free!

[@-Cesh-]

"now that we have an understanding of..." uhmm do we have that? haha

[@Navhkrin]

You know it's good when you want to pay for a free product.

[@radoskan]

Wtf? How good was this video?