AI Hardware w/ Jim Keller

“Our mission is to help you solve your problem in a way that is super cost-effective and available to as many people as possible.”
Listen to Tenstorrent CEO Jim Keller discuss why AI models are graphs and how we built our software and hardware to give you a fundamental advantage at this year's AI Hardware Summit.
Our international team is always looking for new talent, learn more at www.tenstorrent.com/careers
#ai #artificialintelligence #machinelearning #compute #JimKeller #tenstorrent #hardware

[@xThirdOpsx]

Babe wake up, new Jim Keller video just dropped, and it has good audio this time!

[@FastFSharp]

The fact that we got a good mic on Jim Keller is a miracle!

[@VioletPrism]

Dude haha right tho!?

[@albin1816]

200 iq and a billion dollar hardware company. Worse microphones than a russian csgo player.

[@chargv]

😂😂😂 I was about to ask Sennheiser to provide the guy with a microphone for the interest of mankind. Spot-on comment!

[@esra_erimez]

Jim is a *living* legend

[@rexthomas2259]

Jim Keller is a personal hero of mine.

[@fullyverified7491]

Me too

[@quaidcarlobulloch9300]

One of the greatest and most unique minds of our generation.

[@MarcosScheeren]

Where's the buy button?

[@darelsmith2825]

"In Matrix multiply, there's a little term which is: You do n cubed operations for n squared data."

[@cem_kaya]

So what are the numbers how much compute and memory per chip ? how big of a model i can lay out in a small box ?

[@DarkStar666]

Search for "the cost per transistor stopped dropping a decade ago at 28nm", Moore's Law was originally about minimum component cost, not just raw transistor count. I'm not saying it's "dead" or anything, but we're not on the same pace as before.

[@wdonno]

Oops, posted to wrong Jim Keller interview!….. Fantastic interview of an amazing man! Great video. Re discussion of regulation. He is correct, you can not regulate technology. But regulation is critical. Transparency and openness is needed for society to flourish , not just technology and industry. Regulation needs to be ethics based. Human lives are already impacted by machine based decisions. Organizations using these machines must be required to have mechanisms for meaningful and timely appeal. Already too many examples of people cut off from life preserving care through algorithmic errors. Those are easily documented. How many others in other domains go undetected? The opportunity cost to society is too great to not require fundamental regulatory guardrails. See blogpost AI and Power: The Ethical Challenges of Automation, Centralization, and Scale by Rachel Thomas.

[@Navhkrin]

As a software guy I'm down to Jim trashing me all day

[@gorbynr1]

How can I invest in Tenstorrent?

[@Zekian]

I really want to write a compiler that targets this hardware. When will I be able to purchase it?

[@kayakMike1000]

Compilers already exist, it's just many many risc-v cores connected to a fabric...

[@Zekian]

@@kayakMike1000 Yes, but programmers love to re-invent the wheel. Often (naively?) hoping to do it better, and later discovering unforeseen complexity. Jokes aside, There seems to be some interesting opportunities for exploiting the parallelism in this architecture. Somewhat analogous to how out of order execution exploits the partial ordering of a regular single threaded program.

[@YuxuanLin-qv3yc]

Is this a computing-in-memory architecture？

[@marshallmcluhan33]

Where are the retail cards and are any comparable in price/performance vs consumer Nvidia GPUs? I guess everything is CUDA dependent these days...

[@ZayMeisters]

Anyone have any advice on becoming a chip designer? (Books, topics, app notes, classes etc) Thanks in advance

[@Zekian]

Try building Ben Eaters 8-bit breadboard computer by following his video series. He sells a kit on his website. You'll also understand how to build the simplest possible CPU. If actually follow along you will also get excessive experience points in the wire stripping skill. So you may want to consider emulating the design with PCB etching rather than a breadboard and wires.

[@darylallen2485]

I would search what classes are in an Electrical Engineering bachelors degree, then mimic that. Seek out the text books, find Udemy and Coresera courses, read the books, watch online lectures. If I wanted to do what you're seeking to do, that would be my approach.

[@mohammedelsharkawy6541]

You have to start with a Digital Design course and you can use "Digital Design with introduction to verilog HDL by Morris Mano", at the end of the course and as you follow along with the textbook you will learn the concept Hardware Descriptive Languages(HDLs) which are languages used to describe the relation between digital components and behavior of digital circuits. the next course you have to study is computer organization and architecture. some universities teach this course into two separate courses, one named computer organization and the other one is architecture. you learn in this course the internal structure of basic CPU, like ALU and how components inside the CPU communicate with each other and how the CPU communicate with other parts like RAM for instance. while you are studying, try to implement and simulate what you learn using Verilog for example as a strong foundation in it is a must.

[@kayakMike1000]

Moore's law isn't dead!

[@natalianmurillo]

W

[@SorinSilaghi]

This looks similar to the Tesla AI chip, maybe a bit more generalized.

[@fullyverified7491]

Jim made that one

[@zayetsvolk201]

what they got - not allot but they sure talk up a storm :) 6month o silence ... "im standing here a hero of a 1000 psychic wars ...(Live) 10/9/1981 [Digitally Restored] - im not sure if thers anything left..lol AI -im still learning about my 'intelligence' > starting 2 suspect there may not be any! must be all the shakes ;)

[@zayetsvolk201]

Watcher of the Skies Live Shepperton Studios 16mm HD - 30/31 October 1973 > teach it to recognize cosmic ray emissions on old celluloid tape... pre 1945 and post :) see if u believe in intelligence...

[@ChrisJackson-js8rd]

why include the nonsensical brain analogy when it amounts to nothing more than "i can draw an abstract representation of what i'm doing that resembles this image of a rat's brain"? that's ur best argument for why people should give you money? presumably?

[@SaHaRaSquad]

Why complain about a single slide in a 30 minute presentation? If that's all you can take away from it then Jim Keller doesn't need your money

[@esra_erimez]

How can I invest in Tenstorrent?

[@jawk2575]

im looking for it too

[@CianMcsweeney]

You probably can't, unless they ever decide to go public, which I hope they don't for their own sake