How massive Cerebras chips rival Nvidia GPUs for AI

[@DrWaku]

Would you like to have one of these chips in your basement? What would you do with it? :) Happy Christmas for those who celebrate it. Don't worry, o3 video coming soon. Discord: discord.gg/AgafFBQdsc Patreon: www.patreon.com/DrWaku

[@pandoraeeris7860]

I want one in my brain.

[@jsalsman]

Would love to see Needelman-Wunch alignment of two full genomes from different organisms and against library sequences. That sort of thing takes months now, and is essential for accurate methods in computational genealogy. Of course the financial motivation has to do with pharma....

[@theodoreshachtman9990]

I would love an o3 video!!

[@PankajDoharey]

Never, whenever you see "contact sales", most certainly a better deal is available elsewhere. If they are a real product compnay teh hardware should be purchasable from amazon, new egg or their own website. If not they are trying to sell you overpriced crap.

[@ntal5859]

@@pandoraeeris7860 I am sorry but that would just dumb down Cerebras.

[@elderbob100]

Dr. Waku has a very viewer-friendly style of interviewing. Structuring the interview into 3 parts increases intelligibility and creates a logical framework for communication. As a non-academic myself, I find that I am able to comprehend complexity that I could not with other interviewers. Please keep up the good work, Doctor!

[@nanakowwalker-arthur8007]

Hi, around 2:14 when Groq is mentioned, the caption shows (Grok... - correction)... it correctly and not Grok. These are 2 different companies: - Groq designs hardware like Cerebras - Grok is an AI software company like OpenAI. It's confusing if you don't think of the right company in context.

[@nanakowwalker-arthur8007]

Oups... my bad 😂: my brain tricked me into remembering what I did not read! The caption is indeed correct, sorry for the mistake 😅

[@DrWaku]

Haha my editor originally put Grok in two places because that's what the speech recognition wrote, and I missed it on my first pass. Had to go back and suggest Groq. You made me think I had missed one instance for a minute there ;)

[@kiwikevnz]

Cerebras has done an outstanding job and I love their out of the box thinking, their single cpu called WSE is the size of a 300 silicon wafer for one chip, 46,225mm*2, 4 Trillion Transistors, 900,000 Cores, 125 Petaflops AI Compute, 44 Gigabytes of on chip Memory, all built on a Single 5nm TSMC Chip. Amazing chip and it's already broken many World Records. Can't wait for their IPO, it's finally coming.

[@themultiverse5447]

I really like the big subtitles! ❤ I’ve recently developed an eye disease and I didn’t know how much I needed this. Thank you Dr. Waku for making this fascinating topic more accessible 😊

[@minimal3734]

I can heat my house in the winter with 15 KW. Maybe I should buy a Cerebras unit and sell compute.

[@psxtuneservice]

People do that with old btc miner.

[@s3ba2k]

I was kind of wondering when something new will appear and there it is :)

[@DrWaku]

I've been slacking recently. Thanks for checking in. ;)

[@jllacrosse]

What is your ability to mass produce this chip? Will it run on all computers or is it limited?

[@tedguy2743]

I genuinely appreciate your content

[@roccov1972]

Great interview Dr. Waku.

[@DrWaku]

Thank you!!

[@NathanJayMusic]

Cerebras Inference Voice is my favourite AI voice chat, however it can be a bit mischievious, and don't ask it for the ideal speed to drive on a motorway when you're low on petrol.

[@RomaineGangaram]

Lol

[@devon9075]

When is the IPO?

[@DrWaku]

I know right. That's what I should have asked. If you find out, let me know here or in discord.

[@jllacrosse]

Beginner here. Will this replace Nvidia chip?

[@aegis_helion]

It is matter of price, this one is strongest, probably most expensive too.

[@Ormusn2o]

It could replace it for some tasks, but It feels like they can't get much chips out. I don't know why, but they are unable to get it up to mass production, despite having multiple models and that they existed for 9 years already. Maybe there are some problems with yield that make it impossible to mass produce, and it's gonna stay a novelty item.

[@JonathanStory]

I enjoyed this interview, even though there was a steady breeze as a lot of what was discussed went over my head. In terms of value propositions, is Cerebras offering an alternative to nvidia, that better fills certain use cases, or is it a sea change that xAI risks getting left behind by not adopting it?

[@firecat6666]

I think it might be a sea change. Nvidia technically still only makes GPUs, which are things that more or less by coincidence happen to be pretty good at ML tasks. From what I understand, Cerebras and Groq (and others that I don't know about) are going in a different direction with their chip designs.

[@DrWaku]

It's okay, this interview was really technical. Joel is the right person to talk to if you want all the details, apparently. In terms of value proposition, Cerebras has the potential to beat Nvidia in almost all cases. But their hardware has been very expensive (the first nodes were $1-$10 million each) and hard engineering-wise to get right. They also don't have access to enough capital compared to competitors. But I feel like they may have cracked all the barriers they need to. Wouldn't be surprised if their business blows up over the next year.

[@DrWaku]

Yeah Groq is going almost the opposite direction, with really small units that are extremely fast. It's inference specific hardware, so they should in theory have an edge over Cerebras because it's much simpler if all you care about is inference. I think they have harder compiler problems to solve however, and Cerebras has the advantage of handling faults really easily: just disable some cores. I think there's room for both companies to do well though, because they have different specialties. Cerebras is likely to pull ahead if model architecture is changed substantially, at a first impression. Groq is likely to pull ahead if smaller models take off (the way they handle big models is kind of crazy).

[@DrWaku]

Yeah, more of a sea change. Instead of just making GPUs, you should make entire distributed systems including special purpose hardware, memory, networking, etc. Then push as much to the software as possible so that it's configurable and can handle errors better. That's what Cerebras is doing, instead of Nvidia. Whether xAI would be left behind by not adopting this, I don't really think so. They have a lot of money to throw around so they just get whatever is best in the market currently. If Cerebras pulls ahead, I'm sure they'll place an order for a few thousand nodes in the future. Since Cerebras is a startup, they would likely have supply issues if they started getting really large orders. So I suppose it might be a little advantageous for companies to hop on this bandwagon first if it ends up being a thing.

[@firecat6666]

@@DrWaku The only thing that worries me is the ecosystem's reliance on CUDA. Since it's closed source and made by Nvidia, Nvidia can always optimize CUDA to work better on their own hardware and vice versa. Do you see this changing in the near future?

[@meisterblack9806]

do they support video models and quen qwq model?

[@SixOhFive]

Dr Waku sounds like the name of some anime character lol!

[@DrWaku]

Yeah haha. I took the name from the Japanese "Waku Waku", meaning to be excited about something.

[@pondeify]

great editing! thanks Dr Waku for keeping us updated throughout 2024

[@bobbill5838]

awesome content bro. Those chips sound insane, 2.1K token/s is fassst. Would love to have it for some of those open source video gen models.

[@p-51d95]

Would Cerebras be considered a systolic array computing architecture with both data and parameters streamed in from external dram memory? Does my question even make sense? ;-) Update: Never mind. I just reached the part where he describes this.

[@DrWaku]

You took the words right out of his mouth. :P

[@dkierans]

This is great.

[@kylev.8248]

Nuts. This is awesome.

[@DrWaku]

I know right? I thought the same. It just gets better the deeper you dive.

[@WorldMover]

Dr waku you are a legend

[@Charless_Martel]

just like you

[@patruff]

Yes! This is exactly the content I was looking for. I'm wondering why they didn't IPO. Thanks for this 🙏.

[@pandoraeeris7860]

XLR8!

[@DrWaku]

Well you win first post this time :)

[@Gabeyre]

Good luck Cerebras i hope you get big and paid before the AI craze ends.

[@paulmichaelfreedman8334]

Dude, the Ai thing aint ever ending

[@HoboGardenerBen]

Way too high-level for me, I'll leave this to the real tech nerds. Looks like it could be a decorative wall hanging, fun way to integrate it into spaces. Instead of wrapping it up in a boring box, go clear and fully displayed. Use wires and such as materials for art as well as necessary parts of a machine.

[@user-fd7jd4jq1e]

"heterogeneous system architect"?? bring the AGI baby, lol.

[@greanch1234]

gloves?

[@DrWaku]

They're medical. I have fibromyalgia and RA and wearing them cuts down on some pain. Made some videos about it in the disability playlist.

[@marginbuu212]

That's great and all but can it run Crysis? What about Minecraft?

[@RomaineGangaram]

Can it run flipping Crysis?!🎉😂

[@DrWaku]

Sorry, it's an AI chip not a graphics chip. Insert name of whatever model you like and the answer is probably yes, though. It could run a future version of Minecraft where the world and the graphics are all autogenerated by a model, like that recent doom model. That would be cool.

[@420Star69]

Seems like a copy of Tesla DOJO

[@camronrubin8599]

Small minded way to think with so many of these projects currently existing. Tesla trains cars and they are the best in the business , that's not what cerebras does

[@blueskyresearch6701]

Pretty sure that cerebras inspired and informed dojo not the other way around.

[@RomaineGangaram]

Dude it's nothing to be compared. This is not discussing a system but a singular device. A single wafer not a wafer linked to other hardware. This is a system on a chip (SoC)

[@autofashi0n]

I'm all into AI and Nvidia but not to much into LGBT

[@DrWaku]

Well, luckily we don't talk about LGBTQ. You can just listen if you don't want to look. I make the podcasts understandable if you can only hear.

[@communitycollegegenius9684]

The guy in the hat and gloves is a woke joke. Get rid of him.

[@Charless_Martel]

hahaha, funny when he tries to be funny and/or charming, the gloves and hat will make the women go wild . hahahaha

[@communitycollegegenius9684]

@@Charless_Martel Fat blue-haired feminist monsters? Any real guy is mgtow.