The True Cost of Compute

[@a16z]

Topics Covered: 00:00 - The cost of compute 02:30 - Is this sustainable? 03:46 - The cost to train a model 05:58 - Computation requirements 09:58 - The relationship between compute, capital, and technology 13:31 - GPT4 commenting on the technology with help from ElevenLabs

[@sohamlakhote9822]

This was really good :-) Thanks a lot for uploading this series!!

[@andreygorbunov9504]

Good 3 episode series👏. Would be also interesting to hear your take on the different Platform services around AI centric workloads

[@frankdaniel5216]

2:04 probably the first legit “this is not financial advice” claim I’ve ever seen

[@Alex-ym9pu]

Great topic! Incredible to see the comparation with adoption of a tech and the demand of compute

[@GovGpt]

Very informative!

[@yusuf-ri8uw]

Awesome stuff!

[@LloydNebres-m7u]

Illuminating! I wonder whether or not Moore's Law applies with respect to compute thrown at frontier models moving forward.

[@apollokirsch]

Further reinforcement that at its core, this is a hardware revolution

[@ASMRsauce]

Really insightful thoughts on Ai Back to School Giveaway

[@fintech1378]

super fantastic content

[@yen-chenchiang6247]

Interesting topic. It makes me reflect on if we really need this huge amount of cputing works…

[@ashwinkandath1439]

another banger about the chip ecosystem!

[@lnebres]

Hmm. I was actually expecting to hear an actual figure (not just an approximation or estimate), of exactly how much it cost the frontier models to be trained. Still, this episode was basically useful.

[@esSKay25]

I like how they “fact checked” the epilogue, yet the graphics (1,000,000,000 chars) doesn’t match up with the audio math (100,000,000,000 chars). 😅

[@ChrisStilesURL]

No doubt GPU suppliers like NVIDIA are like the suppliers of picks and shovels during the 1849 gold rush. Exciting to see what everyone's building, and to drive through Santa Clara and Sunnyvale and San Jose and see so much silicon still happening in Silicon Valley.

[@tyc00n]

price of power is a real competitive factor, all the lessons from crypto mining apply to the true cost of compute. Also security as people want to steal $10,000,000 files that are less than 1TB

[@a16z]

Don't forget to catch Part 1 and 2 of the mini-series. Part 1: kzbin.info/www/bejne/Y6TChpxrn5V6q9k Part 2: kzbin.info/www/bejne/f4HVlmhobZyDaas