George Hotz | Programming | toonygrad! a rewrite of the tinygrad middleware (1/n) | Hong Kong

[@geohotarchive]

github.com/tinygrad/tinygrad | tinygrad.org/#tinybox | Bounties for tiny corp / tinygrad -> docs.google.com/spreadsheets/d/1WKHbT-7KOgjEawq5h5Ic1qUWzpfAzuD_J06N1JwOCGs/ Pre-order tinybox buy.stripe.com/5kAaGL6lk9uX9nW144 more info on -> tinygrad.org/#tinybox from $1250 buy -> comma 3X comma.ai/shop/comma-3x | best ADAS system in the world openpilot.comma.ai Support George by subscribing twitch.tv/subs/georgehotz | Follow George on twitter.com/realGeorgeHotz to be up to date | Read George's geohot.github.io/blog/ Chapters and twitch chat: TBD

[@invaderg3332]

Wow man you are super genius, I think I find you similar to Mira Murati. I wish you guys were married! You both are super in high up positions, I'm trying to be here in India.

[@dmitriyshiryayev2121]

I swear to god if I have to wait another 3 months

[@sonOfLiberty100]

Don't you have other things to do?

[@rot26-o3h]

@@sonOfLiberty100 I just continuously refresh the youtube page until I see a new george hotz video

[@zowqfn4412]

As he is now in hong kong, in three another months he'd be in north korea xD

[@cryptonative]

@@zowqfn4412the most stable regime tbf

[@semtex6412]

-- DITTO --

[@thsstphok7937]

Geohotz will be the leader of a resistance group called TinyGroup, which aims to build a good AI to fight the AI Overlords of future.

[@fabianwahle5119]

FWIW: 00:03 - Introduction and Stream Setup George welcomes viewers back after a hiatus. Mentions that he has moved to Hong Kong and sets up the stream. 01:04 - Moving to Hong Kong and Thoughts on US Politics Discusses his disillusionment with the American political climate. Expresses a desire for stability and unchanging rules in business. 01:51 - Critique of Brave Browser and Web3 Tokens Attempts to configure the Brave browser. Shares his frustration with web browsers that incorporate tokens and Web3 features. 02:24 - Responding to Questions About Rewriting Code Addresses a viewer's question about frequent code rewrites. Emphasizes building lasting projects over short-term relevance. 03:04 - Commentary on the Fertility Crisis Talks about an underappreciated tweet regarding the fertility crisis. Shares thoughts on long-term horizons and societal trends. 03:41 - Discussion on Browsers and Extensions Mentions using Firefox with uBlock as his main browser. Explains his setup of having a main and a streaming browser. 04:43 - Living in Hong Kong and Language Barriers Shares experiences about moving to Hong Kong. Talks about not knowing Mandarin and the desire to learn it. 05:31 - Thoughts on the CCP and Business Stability Gives his take on the Chinese Communist Party. Discusses the importance of business stability and capitalism. 07:43 - Comparing US and China's Electricity Production Shows data comparing electricity generation between the US and China. Expresses respect for China's growth in energy production. 09:24 - US Software Industry and Immigration Issues Talks about the US brain drain and challenges in hiring engineers. Criticizes the American immigration policy for skilled workers. 10:36 - Critique of US Immigration Policies Expresses frustration with the US visa process. Discusses the difficulties in bringing in international talent. 11:45 - Further Discussion on US Political Climate Comments on the upcoming US election and political instability. Reflects on the similarities between the US and historical empires. 14:53 - Demographics and Aging Population Talks about population pyramids and aging societies. Highlights demographic challenges in the US and China. 17:05 - Experiences Living in China and Doing Business Shares past experiences of living in Shenzhen. Compares doing business in China versus the US. 21:57 - Introduction to Tunygrad (Programming Begins) Introduces Tunygrad as a rewrite of Tinygrad's middleware. Begins discussing the technical aspects of the project. 23:41 - Demonstrating the Tinygrad Visualizer Shows the visualizer tool within Tinygrad. Explains how kernels and operations are visualized. 24:43 - Refactoring and Middleware Discussion Talks about the importance of refactoring code. Emphasizes the need for clean abstractions in long-term projects. 31:15 - Explanation of UOps (Micro-Operations) Provides an introduction to uOps in Tinygrad. Demonstrates how uOps are utilized in the framework. 34:25 - Rewriting Tinygrad Middleware Continues with coding and refactoring the middleware. Discusses the motivations behind the rewrite. 38:00 - Handling Shape Trackers and Graphs Works on code related to shape trackers. Explains the importance of tracking shapes in neural networks. 42:15 - Debugging and Error Handling Addresses errors encountered during coding. Shares debugging techniques and best practices. 46:30 - Visualizing Computation Graphs Uses tools to visualize computation graphs. Highlights how visualizations aid in understanding code structure. 51:57 - In-Depth Explanation of UOps in Tinygrad Provides a deeper dive into micro-operations. Discusses how uOps improve code efficiency and readability. 55:25 - Promotion of Tinybox Pro Introduces the Tinybox Pro and its specifications. Encourages viewers to consider pre-ordering. 59:00 - Updates on Tiny Corp and Future Plans Shares company milestones and future goals. Talks about achieving significant revenue milestones. 01:03:51 - Addressing Viewer Questions Responds to questions about releasing projects and impact. Emphasizes the goal of building lasting technologies. 01:06:00 - Further Demonstration of Tinygrad Visualizer Shows more advanced features of the visualizer. Explains code optimizations and kernel generation. 01:10:52 - Encouragement for Developer Contributions Invites developers to contribute to Tinygrad. Discusses open issues and how to get involved. 01:14:40 - Deep Dive into Graph Rewriting Explores how graph rewriting works in Tinygrad. Shows examples of rewriting patterns and rules. 01:20:00 - Optimizing Code and Performance Discusses strategies for code optimization. Talks about balancing readability and efficiency. 01:25:30 - Implementing New Features Works on adding new features to Tunygrad. Explains the reasoning behind certain implementations. 01:31:00 - Challenges in Software Development Discusses the challenges faced in software projects. Emphasizes the importance of perseverance. 01:36:45 - Interacting with Viewers Reads and responds to viewer comments. Engages in discussions about programming practices. 01:42:15 - Discussion on Programming Paradigms Talks about different programming paradigms. Shares his preferences and reasoning. 01:47:30 - Exploring Chinese Characters and Learning Mandarin Takes a moment to learn Chinese characters. Expresses interest in practicing Mandarin and understanding the language. 01:53:00 - Cultural Observations from Hong Kong Shares observations about life in Hong Kong. Discusses cultural differences and experiences. 01:58:30 - Future of Tinygrad and Tunygrad Shares visions for the future of the projects. Talks about potential applications and growth. 02:04:15 - Working on Kernel Generation Delves into generating kernels for computations. Explains the technical aspects involved. 02:10:00 - Optimizing Memory Usage Discusses strategies for efficient memory management. Works on optimizing memory usage in the code. 02:15:30 - Implementing New Algorithms Introduces new algorithms into Tunygrad. Explains the benefits and performance gains. 02:20:12 - Visualizing Graphs in Tinygrad Delves deeper into graph visualization. Highlights the importance of understanding computational graphs. 02:25:00 - Refactoring Code for Clarity Emphasizes the importance of clean code. Refactors portions of the codebase for better readability. 02:30:30 - Community Contributions Highlights contributions from the community. Encourages more open-source participation. 02:36:00 - Testing and Validation Demonstrates testing methods. Shows how to validate code changes effectively. 02:41:30 - Comparing with Other Frameworks Compares Tinygrad with other machine learning frameworks. Discusses advantages and areas for improvement. 02:47:00 - Exploring GPU Acceleration Talks about leveraging GPUs for better performance. Works on integrating GPU support. 02:52:30 - Answering Technical Questions Takes technical questions from the audience. Provides detailed explanations and insights. 02:58:00 - Finalizing Changes and Testing Wraps up the coding session with final tests. Ensures all changes are stable and functioning. 03:03:00 - Code Review and Best Practices Reviews code for potential improvements. Emphasizes best practices in software development. 03:05:48 - Continued Coding and Refactoring Works on code optimization and handling shape trackers. Addresses challenges and solutions in the codebase. 03:09:00 - Implementing Shape Tracker Improvements Focuses on improving shape tracker functionality. Explains the impact on overall performance. 03:14:39 - Exploring Chinese Characters and Learning Mandarin Continues practicing Chinese characters. Shares resources for learning Mandarin. 03:20:00 - Discussing AI and Machine Learning Trends Talks about current trends in AI. Shares thoughts on the future of machine learning. 03:26:00 - Balancing Performance and Complexity Discusses the trade-offs between performance and code complexity. Shares strategies to maintain balance. 03:32:00 - Interacting with the Audience Engages with viewers in chat. Answers questions and shares personal experiences. 03:38:00 - Final Thoughts on Software Development Reflects on the software development process. Offers advice to aspiring developers. 03:44:00 - Closing Remarks and Stream Conclusion Wraps up the stream due to an upcoming meeting. Thanks viewers for joining and hints at future streams.

[@Fahodinho]

Is this AI generated or do you not have a life?

[@WhyGoThere]

Seem to be off

[@commonlogic3646]

@@fabianwahle5119 king

[@Outplayedqt]

I was born in HK! How neat of a decision. Best wishes to tinygrad for a bright and successful future. Thanks for the insightful stream.

[@Gome.o]

Just wanted to express thanks to the person/team responsible for uploading yet another geohot stream and adding captions for stream.

[@d33w]

Glad to see geohot is back streaming. No twitch chat subtitles tho, I always like to see what they're saying

[@geohotarchive]

@d33w twitch chat will be added later. Just not possible right now.

[@Gome.o]

@@geohotarchive Thanks again for all you do. The amount of effort that goes into these uploads isn't lost on us ☺

[@DilshodFayzullayev-w3k]

​@@geohotarchiveare these videos for tutorial? Where should i start? Can you give me guide?

[@SownJevan]

@@DilshodFayzullayev-w3k No. It just lets you see how he does it, which you can then apply to your own thinking.

[@gillianorley]

Maybe it doesn’t matter anymore, but I just bought my fourth Comma device. My Comma 3X will be delivered tomorrow. I already have one Comma 2 and two Comma 3 units. The 3X will replace one of the 3s which I will now use as a backup. I have them installed in two different vehicles.

[@jeonsiddart6433]

At this pace there's only 10 geohotz streams left in my life.

[@Freezone7]

He doesnt seem as happy anymore :/

[@ultrasound1459]

GF problems?

[@darkuncle77]

@@ultrasound1459where’s that hot girl he used to hangout with and walk with she was cool

[@based4573]

​@@ultrasound1459 first thing I thought of when he started yapping about Hong Kong and America lol

[@andrewcox1677]

George - Good to see you again!

[@MaximumWeeb2]

2:16:43 - for 10 seconds George hums Hillary Duff haven’t heard that song in damn near 20 years 😂🥳🫡🇺🇸 again at 2:23:02 I’m loving it I was a big Lizzie McGuire fan as a kid early 2000’s

[@derekcarday]

wish he'd do 4k so you can actually read the code

[@biesman5]

Wow, this.

[@the_yugandharr]

waaaatt!!! let's gooo!!! thanks for uploading bro!

[@FanDutch]

yaaay was really missing george's streams!!

[@philipphortnagl2486]

good to have you back on streams, programming with you is so much more motivating.

[@idkhidden]

Wake up babe geohotz just posted a new video guess we’re all about to feel 10% smarter and 90% more confused.

[@Koyaanis]

Accurate.

[@DilshodFayzullayev-w3k]

Are these videos for tutorial?

[@klajdikaca1991]

Hahahah

[@commonlogic3646]

We still never give up, never go hollow

[@DilshodFayzullayev-w3k]

Are these tutorials? Where should i start?

[@semtex6412]

"the universe is created by like a dude in the sky" -tomcr00se

[@1boi593]

Things are going down the gutter not only in the US but globally

[@commonlogic3646]

We got depressed George i see, it's okay he has a point. It's how it seems these days. Don't lose hope George

[@More_Row]

He’s not, and if you think he is you have no idea about depression

[@commonlogic3646]

@@More_Row im using the term loosely cheif

[@Akrob55555]

@@commonlogic3646 You misspelled it. Stop being so sloppy.

[@younessasserare5449]

where are the timestamps ?

[@DonRushtheClassics]

Yeah, I'm tempted to move there also. Japan is my second choice.

[@V3racious3]

8:22 You respect fake data and coal power?

[@BP1gaming]

And I thought my notifications were broke....

[@holdingW0]

We love your content George. Keep it up

[@bennguyen1313]

I've heard of the econmoist Robin Hanson, but who is Brian Kaplan? Any thoughts on Vivek Ramaswamy, or Fareed Zakaria ? Regarding the 25% exit task for dropping the U.S. citizenship, Prof G talks about this in the episode "Future of Cable TV".

[@antih8r]

welcome back! e: a few minutes in and to be fair, i've never thought you would actually live in a country where people get extremely high penalties just for asking for democracity. i see your (valid) points why you did it, but liberty was always a great value hackers lived after. you ask for options: "does trump or harris stand for stability? i dont know" - but the point here is: you have options. i wonder how censored your google actually is.

[@TheAsarajesto]

blink twice if you're in danger

[@cryptonative]

I don’t understand moving to China. He could go to Singapore, he could go to India, he could go to Australia, or anywhere else in the world.

[@BritishBungler]

China actually builds stuff.

[@UrienOld]

hong kong isn't too bad

[@cryptonative]

@@UrienOld most countries are not too bad

[@foreigngodx6]

Yeah exactly. Especially considering the things he says sometimes on his livestreams.

[@games-dn7sp]

me too ,

[@treasuretechnology1724]

Hotz was waiting eagery from Kenya. Welcome back

[@1mintechie]

Maan, I love this guy soo much

[@Junior-q3n8o]

we back

[@commonlogic3646]

There will be no time stamps?

[@ShpanMan]

I'll say I wanna join TinyGrad if we get more streams!

[@Cerny3D]

You educate the very select few of us that watch your streams. Thank you George❤

[@6Diego1Diego9]

ironically he has no formal education.

[@nonefvnfvnjnjnjevjenjvonej3384]

Unfortunately, he has also fallen for the brain wash which is happening in the Tech Industry right now.

[@TopFunGhost]

where did all his tweets go?

[@possiblymaybe.]

So you left Alex in the United States?

[@BritishBungler]

They must have split. We never hear about or see Alex anymore.

[@possiblymaybe.]

@@BritishBungler sad 😔

[@Koyaanis]

Very sad. She was cool.

[@RandCode]

Very off-topic question, but does anyone happen to know what KBD that sounds like?

[@Zeroduckies]

My G HOTZ! AI Should be President

[@troyb4533]

You seem like someone that would be awesome to hangout and BS with.

[@con7rl670]

mr george hotz, what a legend... george's podcast episode on lex changed my life.

[@gillianorley]

Ask Jack Ma what he thinks of doing business under the CCP. If you can find him.

[@frkkful]

That's a good look for the CCP. Can't turn China into an oligarchy like the US

[@fant9sy]

gee, poor guy, he can't do monopoly and speculation anymore under CCP :((((

[@fant9sy]

@@Doran_Krotan bro I'd live in HK

[@fant9sy]

@@Doran_Krotan ? HK = Hong Kong, are u fkin dumb?

[@lopwidth7343]

Don't let Root know what George is doing

[@dzienisz]

Your streams help me be better person.

[@the_yugandharr]

it is great to see he doesn't mind videos being uploaded here for free, regardless his streams are not free (or are they?)

[@tanmay4l]

Thank you so much

[@HaKazzaz]

I guess it's time to cast KZbin videos to my 300' TV to see what's going on

[@deersakamoto2167]

George, after complaining about millions crossing the US border, 28:55 "If Bryan Caplan started a political party, that's what I would endorse" without realizing that Caplan's most passionate cause is open borders (he defends both legal and illegal immigration, like any good AnCap would)

[@bobparker6922]

George gets his politics from instagram and Elon's twitter feed

[@Yume-x9v]

ありがとうございます。

[@dfloper]

Hong Kong is a nice place well done.

[@bilalazhar4495]

i missed these streams

[@raphaelmeillat8527]

So nice to see you again! But quite sad to hear about your new "direction"... As for your take on that whole China vs USA, let's just say that it was naive at best! Looking at Chinese prison statistics on the Web and thinking that "all things being equal, you're 5x more likely to go to jail" was the best joke ever! Still... Wishing you the best for this new chapter!

[@psydook]

Bro istg you left and i muted twitch notifications and now i missed this .+. (btw i improved on your twitchchess from back in the day, thank you for that, using reinforcement)

[@Notverygoodatall]

Where's the new episode?😊

[@geohotarchive]

@Notverygoodatall Will try to publish today. Thank you for your patience.

[@Notverygoodatall]

@@geohotarchive all good. I appreciate your effort

[@chickenwings273]

Glad to see him back

[@PatientZiro]

George, you should start a family and have kids. Kids will give you happiness, purpose, and satisfaction.

[@Arniores]

As God intended

[@hanchi8710]

that is selfish thinking

[@southernfriedhackers]

don't end up like Jack Ma, be careful over there

[@pakoul]

3am honey honey wake up ! George's just uploaded a new video.

[@PaleFolklore]

TSMC plant in Arizona is ahead of schedule.

[@martin31337]

you even did say almost 10 years ago what would happen with google on stream maybe more like 6 but close enough

[@Koyaanis]

What was the prediction?

[@rickdg]

What’s the limitation on visas if you want to hire tech people? Don’t you now have even a wider pool to choose from with the layoffs?

[@VincentFulco]

Dude you are freaking crazy moving there. No freedom of thought

[@themodfather9382]

Yeah he's not too bright. You can get disappeared in China and they'll just never hear from you again.

[@ziyodulla_ai]

Babe wake up new geohot steam dropped

[@chrischristi1818]

I know you have the business situation all figured out there... I need a "Hotz Take" on the Foodie sitch!!!

[@Michael-Mosca]

hope george is doing well, thnks for the inspiration, though i never have a single idea what he is coding

[@jendektomas]

What does it mean - we pay 4$ for making sure 1$ is not corrupt?

[@mattmolloy4570]

good to be back!

[@joshcryer]

Electricity generation is relatively flat in the USA because of Energy Star and more efficient technology. This metric on its own without context is not important. An LCD uses less energy than a CRT. This is good.

[@NanneWielinga]

being near schenzen/taiwan must be nice if you are also into hardware (tinybox/comma-ai). Also, Chinese high speed rail

[@harrybilsonia]

so George is the new John Cena?

[@Jack-ii4fi]

So we can be 100% certain that there will never be a TinyToken right?

[@LukmanNazhmudinov]

Can you point a camera at your keyboard? As well

[@byte-worm1669]

Dude where are you been ? We are need your motivation ! More python please xD Good luck in next step in life!

[@mattanimation]

He's back!

[@azize_975]

What's his current setup?

[@Kunal-k-u-m-a-r]

how do you learn a complete language from scratch ?

[@KhattaMeethaOficial]

If he Is In China He Will have Billions in Funding , But as He Resides in Deteriorating Oligarchic , Failing Capitalist Country ,,,,His Brilliance Is Neglected ,Once which On Which American Society Thrived….

[@elfriederich]

I need timestamps 😢

[@wt123654]

CCP stable for business? Bro sleeping on Singapore.

[@eeerrrrmmmmm]

1:41:20

[@valentinguz]

Shenzhen rocks!

[@cottonpaper]

forsen

[@Arniores]

George is the definitely the man

[@GodFenix357]

Mientras otros se preocupan por piratear un iphone para ganar dinero eres un idealista.. realmente me gustaria ser un developer o un genio como tu. Para abrir las mentes de las personas que quedarán bajo total control de la inteligencia artificial. En sus servidores. Tiene que haber alguien que se resista y pueda venderle y enseñarle al mundo como tener su propia inteligencia artificial en su casa sin ningún servidor externo

[@opusdei1151]

You look like Marteria in this stream. This is a German rapper

[@vikaspoddar001]

The king is back

[@newbie20111]

Damn missed the live

[@mementomori8991]

Wait, why did George move to China?

[@fedes9626]

They stopped filtering, on the basis of logic they now use empathy so tell candidates to add visual basic to their CV and they will let them in.

[@HopeCloud-kc1eg]

Do not keep your hairs tiny

[@siladitya005]

Why did you delete all your twitter /X posts?

[@LawpickingLocksmith]

Sadly the world has run out of places for intelligent people.

[@markvr7340]

As a genious i agree

[@ojppe]

Bhaha, is it not running out of places for everyone?

[@marcroallen2450]

天啊？我的偶像geohotz在香港

[@valentinguz]

Respec bro

[@blakenielsen6481]

george went decaf

[@doniya1254]

great to see you in China, I am in China as well. if you need any help, it would be my pleasure. probably after some time I will reach to you and we could collaborate.

[@coIonizethemoon]

cool

[@stencilman5030]

Jack ma who?

[@ColorMeCurious1]

Sad you have nobody smart pushing back, kind of hilarious that you looked at the CN and US population pyramids side by side and didn't even notice how insane of a difference (in US' favor) that is. We all feel a lot of the criticisms you point out and the tide started turning 2 years ago, but it's a slow process. You are one of the quitters, I get it, but if the US falls, there is nobody else coming to save us. Whatever you do, wish you the best of luck, you'll really need it if that's truly your pick. You are able to see why but you are clearly choosing not to see it, so nothing else to add here. whole thing felt like a funeral.

[@hoopnight4758]

How exactly did it start to change 2 years ago? All I see is compounding bad news

[@ColorMeCurious1]

@@hoopnight4758 Deregulation is a major talking point of both front-runners right now. It's over, that conversation is done, we won. I want to accelerate the change, of course, but the conversation is over.