[25] Wei-han Lien, Lead CPU Architect, Tenstorrent

Wei-han was also the lead architect of Apple's M1 silicon. So he knows about high-performance.
[00:00] Intro
[00:09] Wei-Han Intro
[00:15] Why do you need a CPU architect?
[03:05] Vector vs. Matrix math
[04:10] ARM vs. RISC-V
[05:55] What about RISC-V compatibility?
[06:31] Will you publish the CPU design?
[07:01] Why are you going custom now?
[08:43] What can you tell us about Ascalon?
[10:24] Is Tenstorrent an IP or a chip company?
[10:54] What are your thoughts on chiplets?
[12:49] Tenstorrent mobile designs?
[14:40] Use Tenstorrent for Tenstorrent?
[15:52] Training vs. inference
[16:46] How do you scale networking?
[18:20] 3D integration leadership
[19:24] Hardware vs. software
[21:09] How do you deal with future ML algorithms?
[22:56] What architecture is Tenstorrent?
[24:23] What is beyond AI hardware?
[25:09] Multithreading on RISC-V chips?
[26:02] Outro
-----------------------
Need POTATO merch? There's a chip for that!
merch.techtechp...
more-moore.com : Sign up to the More Than Moore Newsletter
/ techtechpotato : Patreon gets you access to the TTP Discord server!
Follow Ian on Twitter at / iancutress
Follow TechTechPotato on Twitter at / techtechpotato
If you're in the market for something from Amazon, please use the following links. TTP may receive a commission if you purchase anything through these links.
Amazon USA : geni.us/Amazon...
Amazon UK : geni.us/Amazon...
Amazon CAN : geni.us/Amazon...
Amazon GER : geni.us/Amazon...
Amazon Other : geni.us/TTPAma...
Ending music: • An Jone - Night Run Away
-----------------------
Welcome to the TechTechPotato (c) Dr. Ian Cutress
Ramblings about things related to Technology from an analyst for More Than Moore
#riscv #weihanlien #tenstorrent
------------
More Than Moore, as with other research and analyst firms, provides or has provided paid research, analysis, advising, or consulting to many high-tech companies in the industry, which may include advertising on TTP. The companies that fall under this banner include AMD, Armari, Facebook, IBM, Infineon, Intel, Lattice Semi, Linode, MediaTek, NordPass, ProteanTecs, Qualcomm, SiFive, Tenstorrent.

[@crispysilicon]

Great stuff. CPUs really are coming along with AI acceleration. Must be a fun position.

[@lesserlogic9977]

Wow, his description of chiplet architecture was fascinating, in conveying the base idea

[@GWM90]

Love this kind of interviews. Very interesting!

[@proskillr]

I know it's tricky being on-site, but we gotta be able to get better audio for these interviews.

[@Stopinvadingmyhardware]

It’s up to them what level of technology they allow in their offices. He was lucky to get an interview.

[@esra_erimez]

Any audio of this renowned gentleman is a gift.

[@kelownatechkid]

Outstanding interview!

[@Karthig1987]

As usual love the video even if i have no idea what is going on in detail lol

[@ConsistentlyAwkward]

So i obviously don’t have a good understanding of this but how are they getting an advantage with using general purpose cores? where are they making up the difference in parallelism is it just easier for software?

[@a.m.g.r7804]

Hi Ian, Im a retail real estate professional for the last 12 years, but I originally started out in IT, been following you since Anandtech days and was thrilled when you launched TTP. love the content your bringing out. I kinda want to get back to IT, I was thinking perhaps I can combine the retail/corporate side of things and be a front for an AI company that needs exposure in Dubai as a hub for the MENA region.

[@Sesarrbg]

Sounds like a good plan, the MENA region has a lot of latent potential in conventional and renewable energy and datacenter business. Unfortunately it can be very risky because technology products can depreciate earlier than expected sometimes.

[@bakedbeings]

I hope Wei-Han, Jim and Chris Lattner have coffee on the regular 🙏

[@russianbotfarm3036]

What does he mean, ‘8-wide’? Like, the Itanium chip, several streams of instructions at once?

[@yaus0527]

It can be consider as a vector processor or SIMD

[@russianbotfarm3036]

Anyone know what the unusual floating point format is, that he’s talking about? Sounds like fixed point.

[@yaus0527]

Unusual floating point format means non standard floating point format (IEEE 754) not only the format also the handling of the operator

[@Stopinvadingmyhardware]

So a torrented security architecture with heuristics by default?

[@owlmostdead9492]

You should move to 32bit audio recording, you're always recording too hot. With 32bit depth, audio clipping is basically impossible.

[@varno]

You don't need 32 bit bit depth, but you do need to set the levels lower. Frankly even 24 bit audio has sufficient dynamic range.

[@owlmostdead9492]

@@varno For someone who doesn't know how to set levels 32bit is a must-have. I could record with 16bit but that's because I know how to set levels.

[@varno]

@@owlmostdead9492 I get that for 16 bit, but for 24 bit the snr is 144db, if you set the levels so that 130db is the Max spl, then there is no audible sound that will not be perfectly clear. There is truly no purpose for 32 bit in recording. 24 bit yes, 32 bit no.

[@owlmostdead9492]

@@varno -I can't seem to find the video I have in mind- If you record in 32bit you can recover from clipping, every time. With 24bit depth you can still cause unrecoverable clipping, that's fact and there is nothing to debate about this either. I'm only arguing that 32bit depth would have saved a lot of recordings on this channel. This is the video I had in mind kzbin.info/www/bejne/a6bcc4ykpL91a80 only the first 20 seconds are relevant

[@varno]

@@owlmostdead9492 And I am saying that the problem is an improperly set Max spl, and not a bit depth issue. From a technical point of view, 32 bits is not nessicary for interview recording. As the average spl is unlikely to have been 100dBA, and levels can be set too hot for a 32bit converter just as easily as for a 24bit one. All 32 bit converters on the market have between 22 and 26 real bits at audio sample rates, the 32 bit number is pure marketing.

[@desertfish74]

Tents to rent.

[@alex84632]

Ian: *breathes* Wei-han: Uh-huh. Right. Uh-huh.

[@AhmedAbdulla2020]

Your voice has an echo