George Hotz | Researching | documenting the AMD 7900XTX so we can understand why it crashes | RDNA 3

[@geohotarchive]

Documentation for the 7900XTX -> github.com/geohot/7900xtx PRs welcome! | 06:56:30 job offer to github.com/gnif | $1000 to fix a reset of GPU for github.com/gnif | 07:02:15 Bounties for tiny corp / tinygrad -> docs.google.com/spreadsheets/d/1WKHbT-7KOgjEawq5h5Ic1qUWzpfAzuD_J06N1JwOCGs/ kzbin.info/www/bejne/op-5gqaAf6uWmsk Hiring entire stack for tiny corp join if you are interested | kzbin.info/www/bejne/op-5gqaAf6uWmsk work major source of value in your life Pre-order tinybox buy.stripe.com/5kAaGL6lk9uX9nW144 more info on -> tinygrad.org | github.com/tinygrad/tinygrad comma 3X comma.ai/shop/comma-3x | best ADAS system in the world openpilot.comma.ai | from $999 comma.ai/shop/body the future of people Support George by subscribing twitch.tv/subs/georgehotz | Follow George on twitter.com/realGeorgeHotz to be up to date | Read George's geohot.github.io/blog/ Chapters: 00:00:00 intro 00:01:25 new KFD backend 00:03:50 never give up 00:05:20 tinybox 00:07:00 looking for comment 00:11:35 docs for 7900XTX 00:13:40 university attendance over time us 00:22:00 vscode markdown preview 00:31:10 signature solar, solaredge optimizers 00:45:45 solar per watt over time 00:50:50 github.com/geohot/7900xtx, tenstorrent software 00:58:20 ubuntu kernel build source don't use apt src 01:01:00 AMD processes, Instinct MI 300, testing in isolation, crashes 01:03:00 no CI for hardware 01:05:50 planning, handling George as PR problem 01:15:00 nvidia taking AMD talent 01:15:50 old instinct cards 01:17:00 test_sdma 01:34:00 firmware file, registers dump 01:37:55 all this docs might be wrong 01:39:30 drivers from AND will not get better 01:46:00 US government people 01:48:10 product engineering, operations, engineering mindset manipulating things not people 01:49:00 everybody who creates is an engineer, administrator not an engineer 01:49:30 boeing, outsourcing, operations keeping systems running 01:51:30 how do you get more gold, more fiat, bitcoin, people 01:54:00 proof of work to proof of stake ethereum 01:56:00 gold works 02:09:00 diversity is our strength 02:19:55 DRM debugging 02:24:19 AMD brutal reviews 02:28:40 4090 tracker 02:39:05 hardware resources 02:48:00 LSDMA, system DMA and other DMA 03:00:00 codenames, UMR 03:05:10 perplexity, searching, search engine 03:09:50 RDNA 3 03:28:50 compute unit 03:35:50 gpu hang, crash, piano 03:39:20 amd community forums 03:41:10 AMD release register reference 79000 XTX 03:42:40 George helping AMD 04:01:35 plum bonito gfx1100 04:03:15 RS64 04:09:55 AMD gpu mailing list 04:13:40 break, shower 04:24:50 should you buy 79000 XTX 04:25:35 AMD PR team, disparaging, George's experience with GPU 04:27:50 the modern consumer 04:30:00 open pilot CI, comma ai failure rate 04:52:50 radeon f32 processor 04:54:20 leak, leak is a public domain 04:58:50 XML dump of bonaire register docs 05:00:00 internet is under attack, remember when google worked 05:01:00 2014 05:06:00 free speech, hate speech, iq vs free speech absolutism 05:17:40 MEC, amdgpu microengine compute 05:46:50 how to power cycle pci device 05:50:15 AMD I want the MEC 06:24:10 error: object file empty git 06:27:25 docs for 79000 XTX overview 06:35:40 SDMA+RLC are F32, RS64 06:38:10 AMD source about register access 06:41:55 ibm rs64 32-bit 06:46:10 rs64 soft core 06:50:50 Alex, RDNA 4 06:53:40 reading about workload managers 06:55:30 the AMDGPU code base 06:56:30 job offer to github.com/gnif 06:57:20 writing software, taping out chips 06:58:40 prediction on AMD high end GPUs 06:59:35 qualcomm reverse engineering 07:01:30 openmax, OMX 07:02:15 can people draw attention to this? 07:03:40 looking glass 07:05:35 internal AMD docs 07:06:40 tinygrad new driver, new style of driver, CommandQueue 07:07:20 $1000 to fix a reset of GPU for github.com/gnif

you sir or miss, are a beast

[@insydegroup]

AMD should start paying you money only because you are doing this. There 20-30k of work out there for average engineer with access to internal documentation.

[@user-og9nl5mt1b]

Why don't you pay him .

[@tear728]

Maybe even more? This would definitely be a juicy contract

[@oooogaabooogaa]

If they cared…

[@sassycat77]

@@user-og9nl5mt1b??

[@SentientArtist]

Missed the timestamps past couple of streams. Thanks!

[@geohotarchive]

Very hard to make them in time for publishing if George streams multiple days in a row and time is limited to make them.

[@davidmora2241]

​@@geohotarchive Are you making them manually? If so, have you thought about training a small model to do them? Seems like a fun little project :)

[@geohotarchive]

@davidmora2241 yes all manual work for now. Automated creation maybe coming in the future. On kzbin.info/www/bejne/Y5qrZqqse9OmgdU @dhom500 posted in the comments example of automated creation. A lot of repetitive text in automated chapters and key points might be missed in the video. Will try to do them manually and see how they compare to automated chapters.

[@starshipx1282]

@@geohotarchivebut it will be better than dhoms if finetuned on your manually created ones in the past. You do really good ones tho.

[@PabloAntOyarzo]

@@geohotarchive Make a stream to watch you make the automation

[@pidojaspdpaidipashdisao572]

this world would fail without people like you

[@_MrCode]

even AI researchers like Andrej Karpathy praised this channel

[@Dom-zy1qy]

AI researchers are just people

[@_MrCode]

@Dom-zy1qy. sure they're but are more intelligent then average yt programmer.

[@snarkyboojum]

At least until AI research is done by AI :D@@Dom-zy1qy

[@ashutoshpadhi2782]

who, and when

[@ultrasound1459]

​@ashutoshpadhi2782 Lex "I work at MIT" Fridman 🧏‍♂️

[@rakolman]

at 1:58:50 George inadvertently provided the very reason why gold will fail as money: asteroid mining. Asteroid mining can increase the supply of gold SO dramatically to the point of making it useless as a store of value.

[@tear728]

You're a god for doing these timestamps bro, that's a lot of time to spend

[@arthurcolle2778]

im sure its an autotranscriptor

[@geohotarchive]

@arthurcolle2778 no it's manual. you try to make them automatically and see the results and compare with manually created timestamps...

[@arthurcolle2778]

​@@geohotarchive you dropped this 👑

[@jynx3383]

@@geohotarchive Dude i don't know what you get for doing all of this but i hope you atleast get some revenue from this channel, you've been doing this for so long really appreciate it. 💙💙💙

[@deiloncutamora5236]

I just let this video play throughout my day

[@switzerland3696]

For solar Fronius for AC couple inverters and Victron for DC / battery coupled inverters, they are the industry standard outside of the US. A lot of installs use both. For install, it all about putting down a t-slot matrix on the roof, then the panels just attach to that.

[@hola-kx1gn]

Nothing more inspiring than watching geo work on not-so-easy problems... a lot to learn from this guy

[@imnutrak130]

George Hotz at 6:58:40 was on spot with his prediction

[@HaydonRyan]

Big problem with a lot os solar is we put it on roofs. If you’re mounting on a dedicated solar structure, then you can choose the direction or have a moveable base. Of course this doesn’t work on small blocks of land.

[@kħ0]

can some one explain me what he is doing / explaining

[@shadfurman]

Solar is usually wired in series up to around 500v 10amps. Much more than that, you do another run. They have special socket connectors that make it pretty hard to touch the contacts. Solar is pretty easy to install, the problem is, you're problem is, if it's roof mount, you're putting lag bolts in your roof and you want to make sure they're sealed well. If you haven't done roofing, you probably want to have a roofer show you the basics. Go with a high end sealant like geocell. There are a bunch of different varieties, but usually it consists of a mount plate you bolt through your roof into the truss (use a hammer to find the board, stud finders usually won't work, sometimes infrared will, but just use a hammer, you can hear it). Once the mount plates are in, you have a bunch of hardware you can bolt to the mount plates. Sometimes they clip directly to the panel, sometimes you'll have rails that you bolt to the mount plate and lock to the panels. There are KZbin video instructions for all the different varieties. I like the low profile ones, but they're harder to get flat (your roof probably isn't as flat as you think it should be), and having a giant specular surface just accentuates it. And they're more expensive. You'd probably want an electrician to install the inverters and everything. You can run the pipe for it and fish your wire through it, but with government regs, it's probably worth having the electrician do it.

[@shadfurman]

You also might want to have your roof done first actually, depending on how old it is.

[@TheBackyardChemist]

TBH I would not put 500V of cells in series, unless the area is free of partial shading.

[@re_detach]

0:13:13 truth. One has to have a desire to learn, you really have to know what you want to get the most out of any sort of formal education.

[@pham3383]

i like this guy,4th year electrical majoring computer embedding technology

[@tylermiller4466]

2:10:01 The way he said, "Poor Mark Cuban" had me dying 😂

[@mikestaub]

I agree fiat currency is the root problem. I also used to think Bitcoin would fail for the reasons you described. Then I lived through the blocksize wars and realized that there is a small group of literally religious followers of the protocol that will never change the 21 million limit. As a nonreligious person myself I underestimated the power and irrationality of such a belief and the effect it can have long term. There will always be many forks on the source, but there will also always be at least 2 nodes running the "real" Bitcoin, thus the network is practically invulnerable. Gold cannot function as money because you can't verify the total supply of the market without intermediaries. Its pure physical nature makes it vulnerable to centralization and confiscation. Bitcoin is both natively physical via PoW and natively digital. It's perfect money.

[@shaggyfeng9110]

Thank you guys

[@AbcXyz-rn2lz]

At least he picked the vendor who is doing FOSS work. I have the 7600 and 8700g if you need testing. I'm doing VCN 4.0 work with ffmpeg source

[@holthuizenoemoet591]

The high cost of solair panels can probably sidestep by not hooking into the office braker box, like having it supply the servers and AC directly instead of the whole building. The system can sill be net following but just internally right. idk about regulations though

[@themodfather9382]

Looks like dedicated AMD GPUs have around 7% of the total graphics market on Steamcharts. The rest is Nvidia and Intel

[@mephisto212]

Hey man, I work for a sad company doing sad work, but I never give up! Also my kids aren't sad and I don't have a sad pool, so I have that going for me at least.

[@lopwidth7343]

You are sad

[@-mwolf]

What we need is democracy in our economy. *Workers* elect their representatives, "managers & bosses". Workers decide what we need to produce, what to focus on.

[@Henrique-wy6cv]

It Will fail like every democracy, polítics Will take over and the end result Will be the asame If not worse

[@rstewart2702]

Oh, man, this stuff is so real and raw. Had no idea he even pulls an LBJ every so often and walks over to the toilet to empty his bladder whilst the microphone is hot…

[@faceofdead]

Watching George makes me wonder why am i losing my life as an IT support and not grow, domatos and cucumbers for example. great content

[@CFlandre]

Also an IT guy. George is an incredibly smart dude, and not everyone is George! And honestly, that's okay, you are important in your own way. It's all about using your power/knowledge for good.

[@udirt]

That is part of the job, we all wonder (and the trick is to stop and remember be amazed by what we can do with all the stuff and not be pissed because nothing works.

[@PsychoBenches]

George, I have a friend here in austin that works at AMD, and he even tells me that the radeon firmware is dog water. AMD has the hardware but they just have an issue with manpower, they've been having lay offs often this year especially. Nobody to fix these problems.

[@holthuizenoemoet591]

nobility but without the class, the administrative class might think they are sophisticated but that is not really the case. At least true nobility back in the day contributed to the development of fine art, classic literature, amazing architecture etc.

[@keyboard_toucher]

1:47:15 computers replaced the jobs of computers :)

[@a_pullin]

Your streams are absolutely great! but: your room does have *a lot* of echo. Maybe add a shag rug and some more flags to deaden it a bit?

[@nikhilchouhan1802]

The channel isn't owned by George hotz lol. He streams on twitch, just the owner of the channel records and uploads those vids with added subs

[@a_pullin]

@@nikhilchouhan1802 oh. I somehow missed that. I’ll ping him on twitch then 😅

[@Alex-md5zd]

this dudes cracked and i love it

[@ricksousa2451]

Obrigado por desbloquear ps3 a comunidade é muito grata a vc !

[@shadfurman]

Markets are diverse.

[@billyblackburn864]

i hope they hire this guy

[@AntonioDellaRovere]

PIZZA ..totally agree :D

[@re_detach]

05:07:00 On the topic of free speech; I fear that as we go into the future the Constitution and its Amendments will be read hyper-literally. For example; the freedom of thought is not protected by the constitution, even though freedom of speech is protected by the First Amendment. So if you never think a specific thought you will never speak on that thing.

[@shephusted2714]

bipolar dev - real open source ai for smb sector is 5 years away - cxl will help a ton, prices will drop and sw will mature and once smb gets onboard for local open source ai with uncensored models, real time analysis building both a search engine framework and sentiment analysis and p2p elements where people can share training data and models - once these things happen we will see more innovation and discovery - it will be a tidal wave compared to big tech ai efforts we see now, good for george for having the initiative

[@uzizizu]

dude please don't cheep out on a good mic.. your stuff is golden! sm7b / re320 / re20 + any sound card ( connection is ease mic > soundcard > pc ) or a directional mic (off camera) such as Oktava МК-012 / AT875R / MKH50

[@elizabethsuehr9293]

lol "Solar is my new hobby" - me last December

[@edugar88]

Man, why can I only give you one like

[@danielfaller5617]

I could buy panels for 19 cents per watt right now.

[@-mwolf]

Speculation in the market is so high because there are little productive investments to be made due to overproduction (ppl cant afford the shit they produce, natural tendency for capital to produce way too much when a sector is profitable).

[@-mwolf]

The reward function is not the manipulation of people, but money! It should not be a cheap proxy, we should rationally plan to produce what we want! That's why society is fucked, because profit as a proxy for what we want can be cheated, e.g. as you say by manipulation instead of value creation.

[@morningwombat]

George, I need your stack.

[@dwi4773]

Wouldn't it be worth revisiting FPGAs at this point?

[@PPPpppppppppopop]

thank you afterworktech

[@shadfurman]

Free speech is absolute. Incitement to violence isn't about speech at all. This should be obvious, you can say the same exact thing, even the same way, in a different context. Obviously, in a movie, a play, a joke, by yourself, etc. Incitement to violence is about the threat. It applies if there's no speech. If you point a gun at someone's head, you don't have to wait for them to pull the trigger to defend themselves. But you have a right to bear arms, you have the right to point a gun, you even have the right to point a gun at someone's head, Penn and Teller used to do it all the time. If it's a bright green squirt gun, it's not a credible threat. If it's an accurate replica squirt gun, it doesn't matter it's a squirt gun, people don't know that. It's a credible threat.

[@memedaddyz]

AMD crashes because it's dog shit. I have it crashing all the time, it's because AMD don't even bother on fixing it many many years. Especially Windows Updates AMD issues. This is why I want to switch to NVidia

[@jamesjamey8596]

Thanks but the keyboard is a bit too loud

[@thorbenenmadrid7114]

You can always change people to stop using gold no?

[@MARKXHWANG]

You cannot manipulate the whole words nodes

[@EudaderurScheiss]

with amd i dont get why they had such success with their cpus, but handling their graphic cards that poorly

[@NootNoot.]

Simply, Intel stagnated, and Nvidia kept on improving with arguably perfect execution. AMD caught up with the former, and still playing catchup with Nvidia

[@hdthor]

ATI drivers were crap and AMD never cleaned house after the M&A. Their cpu microcode and firmware is good and QA’d well. Their gpus are not QA’d well.

[@Edge9404]

AMD has always been a CPU company first and foremost.

[@hdthor]

@@Edge9404 AMD is 3 companies merged together. AMD (cpus), ATI (GPUs), and Xilinx (fpgas). Back when AMD bought ATI, ATI was only slightly cheaper than NVDA in mktcap. But cheaper doesn’t mean better.

[@Edge9404]

@@hdthor that's not what I said though. I just said that they prioritize their CPU division.

[@snorky4708]

On Next Weeks Episode - Documenting AMD’s flawed GPU once again.

[@EneRec]

The only thing I hate about AMD GPUs is the unstable drivers. The hardware is awesome and the features are better than Nvidia in some circumstances like image sharpening (Nvidia had to remove that feature because of how bad it was LOL) But it's just the crappy stability issues with the random stutters and the video encoder/decoder being bad

[@EneRec]

They are building a good reputation with AFMF (Fluid motion frames) and I hope that makes them realize of something. If they try, they can do anything possible, and if they achieve stability they could take over nvidia for gaming. I hope they learn

[@thomas-uj1zj]

diversity is our strength

[@yourma2000]

Imagine agreeing with Userbenchmark.

[@prasanjithpatel9490]

Hey George

[@JoeStevens-x7k]

I thought you guys were in CA. Doesn't CA code say you need to be grid tied? If so, I do not think you need to draw from the grid. That is the reason batteries are a good idea. Read the NEMA 3.0 and you will understand why storing power off grid is preferred. You do need permits but you can act as your own GC, write up the plans for the design of the solar panels install and take the permits out yourself. You can then in theory hirer your own labor or do it yourself (with youtube and/or a GC/Electrician). You just need to learn some basic electrical infrastructure and put in the work. Infrastructure innovations and standards do not change that often like coding or software; it is more like (layer2) networking protocols, i.e., BGP, OSPF etc., and easier to learn.

[@-mwolf]

No one you can manipulate to get gold? ^^ You can manipulate people to go to war for you for gold even if it's not in their interest. If you possess enough gold / means of production, you make the state keep people obediently working for you, so you can get more gold without working, while they get the scraps they need to survive.

[@realzug]

This is like watching a high IQ Destiny stream. Keep it up George. Edit: Just learned that this is just an archive channel. Not his official. Keep up the great work!

[@tear728]

Destiny is a pea brain compared to Georgie 😅

[@nasko235679]

Bought a 1000$ 6950XT a year and a half ago and I can confidently say that they do not care about stability and user experience. Their forums are riddled with people who're having grey screens/black screens/random crashes. Their AV1 decoding was broken for 3 months then their h265 encoding was broken for another 6. I never thought I'd be sorry for not buying a price inflated 1600$ 3090 at the time but I genuinely am. That 600$ price premium would've saved me a lot of grey hairs and troubleshooting only to realize that it's a GPU problem that I can not fix.

[@JohnSmith-ro8hk]

PEBKAC

[@nasko235679]

@@JohnSmith-ro8hk Yeah my bad for being unable to write an usable AMD driver I guess. Didn't know that was part of the customer agreement.

[@JohnSmith-ro8hk]

@@nasko235679 PEBKAC

[@olivur_1459]

Is that Python?

[@enteyedos]

yo ! need some help deploying my virtual machine, mind back me up!

[@Basieeee]

Lol I just bought yhis GPU

[@mcdonaldslover52]

so isnt tinygrad just dead now because you can't actually fix the problems with the software you wanted to fix the entire time?

[@channel11121]

tinygrad isn't only for AMD cards

[@alexeykononov5596]

> so we can understand why it crashes Dude, forget it, man, just buy nvidia 🍭

[@werren894]

or researching nvidia so we understand how it's work 😈

[@ultrasound1459]

​@werren894 its not open source

[@werren894]

@@ultrasound1459 so does windows, apple and playstation, he used to hack.

[@alexeykononov5596]

​@@werren894 when you have enough money, it makes more sense to buy the problem out (because it might just be a hardware problem and in that case, you'll end up disabling accelerated feature by feature, which won't give you any functionality you need at all)

[@werren894]

@@alexeykononov5596 software engineering would not exist without hacking and knowledge of hardware would not exist without security research, since the very begining the point of software engineering is to bootstrap instruction to hardware, and in order to do so one should learn, humans doesn't know science because we don't make it, but we are here. so if you care about problem you solved it not buy it.

[@Bk_owns]

I love my xfx merc 7900 xtx