Season 1 Ep.1 Andrej Karpathy on the visionary AI in Tesla's autonomous driving

Рет қаралды 74,807

Күн бұрын

On the first ever episode of The Robot Brains podcast, our host Pieter Abbeel sits down with Andrej Karpathy, director of AI at Tesla. Andrej is a world-leading expert when it comes to machine learning and training neural nets. In this episode he talks about what it's like working with Elon Musk, training driverless cars with machine learning and the time he had to sleep on a yoga mat at Tesla HQ.
Table of Contents:
00:00:00 - Introduction
00:02:10 - Early days
00:05:13 - Learning and teaching Deep Learning at Stanford
00:16:39 - Joining Tesla from OpenAI
00:23:55 - What it's like to work with Elon Musk
00:26:56 - How AI works within self-driving cars
00:39:01 - Neural networks and data audits
00:48:43 - Building confidence in the system, QA processes and annotation
00:53:58 - "Operation Vacation" explained
01:03:03 - Why does AI compute matter?
01:16:00 - Andrej's view on the future of AI
Links:
Andrej's Twitter: / karpathy
Andrej's Website: karpathy.ai/
Subscribe and listen to our podcast today:
Spotify: open.spotify.com/show/2qbLq3H...
Apple: apple.co/3k8esVG
Google: bit.ly/3sx1mVN
Host: Pieter Abbeel Executive Producers: Ricardo Reyes & Henry Tobias Jones Audio Production: Kieron Matthew Banerji. Video Production: Bo Obradovic.

Пікірлер: 48

@Joshua__Tan 2 жыл бұрын

33:04 “Luckily we are in position with these neural networks that, as long as the dataset is improving, there’s no real upper bound on the performance of the network.” Full Self Driving looking good!!

@vineetgundecha7872 2 жыл бұрын

Always inspiring to see Karpathy!

@mahneh7121 Жыл бұрын

Ended up here after your (Pieter) interview with Andrew Ng. I am so happy to discover this podcast early enough. It is likely going to become more and more viewed. Sharing it as much as possible. =)

@Joshua__Tan 2 жыл бұрын

23:52 Karpathy talks about Elon Musk

@cyrusadamrevilla3851 2 жыл бұрын

38:01 Here he basically says that Self Driving Cars are guaranteed to happen. It's only a matter of Data collection, Training Cluster(Dojo) and time.

@mkavigil 2 жыл бұрын

Great Podcast. When I was at Tesla we had to evaluate the first version of autopilot before the roll out. It was mind blowing experience enabling AP1 on highway 880 and letting go of the steering wheel. This version was a bit sketchy with it abrupt changes direction at 8ph and it’s in this experience that led me to satisfy my curiosity and understand this process more. This Lead my to UC Berkeley’s course in where I met you Pieter.

@mydutube 2 жыл бұрын

You should mention in the video description that this episode was first launched in March 2021.

@sugumarprabhakaran 2 жыл бұрын

Great video! Really interesting insights into computer vision, deep learning and Tesla strategy!

@TheRobotBrainsPodcast 2 жыл бұрын

Glad you enjoyed it!

@rowland5951 2 жыл бұрын

Great stuff

@mydutube 2 жыл бұрын

Why is the screen frame is so small :). Thanks for uploading the video.

@NoStackEngineer 2 жыл бұрын

i think it looks pretty good actually

@jlou888 Жыл бұрын

Great podcast, thanks a lot 🙏

@xaviermachiavelli5236 Жыл бұрын

@yunque30gmail 2 жыл бұрын

that man is a true genius!!!!!!

@johnhammer8668 Жыл бұрын

Its time to bring back again in few months

@sejong-ai 2 жыл бұрын

Cs231n class is also popular in Korea :)

@BreakneckTrent 2 жыл бұрын

We can also approach FSD from an infrastructure position.. With all this money flowing into roadways, it would be beneficial to reduce edge cases by improving and standardizing road markings and road rules nationally in the US to start. 🤔

@GBlunted 2 жыл бұрын

I love how he refers to the mnist set as a toy problem when that's the basic set they teach first timers with these days lol! This was first time I heard your cast, and this was awesome conversation, I subscribed! One thing I wish he would have talked a bit more about was synthesizing of the training data they do these days because I thought they teamed with Nvidia and they now make good enough computer graphics engines that they can synthesis whole drive scenes with CGI thats easily good enough to fool the Tesla cameras into thinking it's real and use that to train on?

@thivuxhale Жыл бұрын

i love your avatar

@simonAdeWeerdt 2 жыл бұрын

Could you have dual networks which learned separately and see whether the they agree on the model constructed? Can we measure how confident we are of the model constructed?

@simonAdeWeerdt 2 жыл бұрын

The deep learning mentioned from U of T sounds like "feature detection", as done in the brain? Our model of our environments seems to be collections of objects which are each collections of features?

@I_dont_want_an_at 2 жыл бұрын

How do you build confidence in the system? Not exactly the problem. The problem is making it work. if it works , we'll be confident in no time

@nelsonelijah5327 Жыл бұрын

As he speaks, he visualizes. That's expertise. You can see it in his gestures.

@CYBRLFT 2 жыл бұрын

This is my 3rd time revisiting this interview. Can’t get enough. Got a question for anyone who may have the machine learning expertise for. I’m an FSD Beta tester. The neural nets running in the Tesla FSD system… as far as active or real time learning or improvement. Is that possible? Or does it require the subsequent update to realize improvements in the data? The latter makes more sense but I’ve noticed improvements or apparent improvements on several obvious occasions before an update actually comes to me.

@CYBRLFT 2 жыл бұрын

@@Doug97803 I appreciate your input. I do think that's right. I've been learning and familiarizing myself with some of the intricacies and now I think the apparent improvement is due more likely to image memory data used in generating the vector space. It does persist, but just not sure how long. Given that I'm on the road pretty much all day every day, I hypothesize that it's maintaining a higher memory persistence cache. This is all me speculating lol.

@TheRobotBrainsPodcast 2 жыл бұрын

Glad to hear its been useful to you!

@TheZeeray Жыл бұрын

All the compute or close to all of it is being used on the FSD computer for operating the AI, data input from sensors, and driving the car. There is no room for anything else useful. This was done on purpose, its safer and makes more sense to do training in a datacenter, and build a cost effective and powerful computer to run the trained NNs from those datacenters. They do use dedicated “shelved/racked” FSD computers for certain things in a datacenter.

@rushibrahim716 2 жыл бұрын

Good stuff!

@TheRobotBrainsPodcast 2 жыл бұрын

Glad you enjoyed it

@simonAdeWeerdt 2 жыл бұрын

Is the number of fire hydrants required related to the facrt humans can re-use features and don't build fire hydrants from the ground up?

@chrism.1131 Жыл бұрын

It's one thing for an AI system to recognize a fire hydrant but it will take a whole nother level to see a shadow of a fire hydrant and not only know that it is the shadow of a fire hydrant but also why a fire hydrant would have a shadow in the first place not to mention also knowing what a fire hydrant is used for, or that water comes out of it, why it would be painted red or yellow, the list goes on and on about things humans would infer just from seeing the shadow of a fire hydrant.

@chrism.1131 Жыл бұрын

1:18:50 AI technology is not upper bounded in any real way… What a profound statement.

@swait239 2 жыл бұрын

Karpathy website link please?

@TheRobotBrainsPodcast 2 жыл бұрын

karpathy.ai/

@user-lr8dp4zt2w 2 жыл бұрын

Video of Andrey Karpathy talking to his AI bot

@jordieclive 2 жыл бұрын

Why is Andrej speaking slowly cf. to his younger years??

@kkochubey Жыл бұрын

Self-driving car is impressive problem to solve but it is hard and without human level reasoning it would not be accepted. People do not like to trust black box. Human reasoning is required to make human level decisions. Would be better to solve human reasoning so deep network can talk to people and do some less critical/dangerous tasks like programming. Once this is solved and DN really can write code better than humans and explain/debate it in native language than you can really start working on self-driving problem. Human are social animals, and even animals are much better than black box, animals at least have some predictable intuition like horse that used to be self driving vehicle for a while in human evolution. Humans should be able to ask their car on why it turned here and not there and if there is no good answer it will not be trusted for a while.