Chasing Silicon: The Race for GPUs

[@a16z]

Topics Covered: 00:00 - Supply and demand 03:03 - Competition for AI hardware 04:46 - Who gets access to the supply available 06:28 - How to select which hardware to use 08:59 - Cloud versus bringing infrastructure in house 13:26- What role does open source play? 16:48 - Cheaper and decentralized compute 20:16- Rebuilding the stack 21:31- Upcoming episodes on cost of compute

[@zuggrr]

20:40 it's crazy that it's kinda what Alan Turing said in "computer machinery and intelligence". What a boss

[@tyc00n]

music in the background is silly because people watch these at 2x speed and it sounds terrible and distracting 😄

[@Hypotemused]

Agreed. We come to listen to the speakers. Why this crappy psytrance behind?

[@fintech1378]

its actually AI generated

[@tschorsch]

​@@fintech1378 It's still annoying.

[@lnebres]

This is amazingly informative. Thanks for giving Guido this platform to share his experience!

[@3ool0ne]

Good job so far on this series. Really looking for the next episode that explores the actual cost. Will likely help many founders’ with their ‘ask’ slides. Might not help since complex inferencing will be needed for next gen AI platforms.

[@gileneusz]

17:12 well, this is the measure how quickly things are evolving, now we have Falcon 180B

[@SushantRao-c2j]

Great job explains the situation with GPUs

[@ashwinkandath1439]

amazing content! it is a fun race to watch and see how the supply chain evolves

[@a16z]

Catch Part 1 of the mini-series here: kzbin.info/www/bejne/Y6TChpxrn5V6q9k

[@chrislatorres]

Thanks Steph, this is really next level content!

[@jdevoz]

There is a finite amount of fab house capacity, gets eaten up by big companies like Apple, etc. Can’t bring new fabs online quickly, etc. Haven’t seen any projections on how this might slow AI rollouts and work its way back to throttling the growth (and share prices) of companies like Nvidia. Next, this opens the door to competitors, gives them more time to catch up, etc.

[@Ficjonis]

Semis really seem like new oil, they are crucial for anything related to new technologies.

[@Hypotemused]

@a16z - when is part 3 being released?

[@a16z]

This week!

[@Hypotemused]

@@a16z⏳

[@shangonghowe]

Oh noise! 😮

[@CyborgHGWF]

How about the race for DPUs and QPUs ...GPUs are getting old man.... ever since last year and the Ethereum Switch over to Proof of Steak

[@tschorsch]

Tone down the absurdly annoying music.

[@fintech1378]

fantastic podcast