Sertac Karaman: Robots That Fly and Robots That Drive | Lex Fridman Podcast #97

[@lexfridman]

I really enjoyed this conversation with Sertac. Here's the outline: 0:00 - Introduction 1:44 - Autonomous flying vs autonomous driving 6:37 - Flying cars 10:27 - Role of simulation in robotics 17:35 - Game theory and robotics 24:30 - Autonomous vehicle company strategies 29:46 - Optimus Ride 47:08 - Waymo, Tesla, Optimus Ride timelines 53:22 - Achieving the impossible 53:50 - Iterative learning 58:39 - Is Lidar is a crutch? 1:03:21 - Fast autonomous flight 1:18:06 - Most beautiful idea in robotics

[@Vaeldarg]

So, even as a computer science graduate I'm not nearly as experienced as an MIT professor, but you might want to remind him that computer science has struggled with the problem of predicting the future before in the form of CPU schedulers. The answer ended up being that it is impossible to know the future for sure, and you have to settle for only accounting for the most likely possibilities and reacting as issues appear.

[@mattgreek1066]

Glad to hear you enjoyed it, Lex. You always enjoy it.

[@mpricop]

I love that youtube now integrates the outline in the video itself.

[@brianbouf8303]

What are best books to read for programming?

[@lucaswood7602]

One of the best intellectual podcasts around. Thanks so much Lex!

[@ai-ur5uv]

Greetings from Turkey 👌 Thank you

[@whitebusinessman]

Great discussion. Thank you again, Lex. Could we please have Andrej Karpathy on this show?

[@isaaclatterell1364]

THIS!!!!

[@Astrophynstein]

Book it Lex!

[@tyfoodsforthought]

This!

[@SamiulAlHossaini]

Please bring Karpathy !

[@karya5571]

We are definitely proud of him and see him as a mentor too! Love from 🇹🇷💜

[@yusuft.3587]

🇹🇷🇹🇷🇹🇷

[@jaymn5318]

Lex, I am big fan of your podcast. Very honest, straight forward questions that brings out the best knowledge of the guest. I cannot thank you enough for educating the audiences.

[@feelandchange9600]

İnsan bir ayrı mutlu oluyor

[@aalokatharva4825]

1:21:16 literally gave me goosebumps!

[@Djorgal]

He didn't mention the issue of noise when it comes to making flying cars. We don't only need to make it safe, we also need to make it very silent.

[@korhanalkan6963]

As bayrakları as

[@zeppelincheetah]

What does that mean? Google translate says "ace flags"

[@mertkusku]

@@zeppelincheetah It's basically a popular saying in Turkish social media. It means "hang the flags". It is used in a tongue in cheek way, when some Turkish person does something nice, makes an appearance on the international arena, etc.

[@Crazylalalalala]

That was great. The fact that we are at the physical limits on many of these technologies was really interesting thing to think about.

[@totalfreedom45]

*_1_* With his rich baritone voice, excellent American English pronunciation, and deep questions, Lex Fridman is the best interviewer on KZbin. *_2_* 1:11...Right on target, Lex! 👏 Are you into cryptos? *_3_* Sertac Karaman is brilliant, as all MIT professors are. 👍 💕 ☮ 🌎 🌌

[@azizutkuozdemir]

thanks Lex . Sertac Karaman adamsin .

[@NeuroReview]

Rating: 6.9/10 In Short: Futuristic Flying (and driving) Focused Notes: This convo was a lot more focused than many of the future lex pods with AI related people, which I think givin the 1.5 hour length was actually good. Neat to think about a future where we have self (or semi autonomous) flying vehicles that take us from boston to NYC, a thought experiment that they talk about a lot here. Sertac is a very humble, honest, and clear speaker, but a bit of a nerd (in a good way). The whol eidea of optimus ride was talked about in the perfect amount of detail and super cool, but interesting how this was 4 years ago from the time I've watched it and I still havnt heard much from this. Seems like the timing of a lot of these kinds of ideas/companys is less on the scale of years and more like decades. Would be cool to have him on again now and get more of his story and background and purpose.

[@erfanebrahimi9748]

As always, I didn't realize time passing when listening to your podcast. The best AI podcast. Thank you Lex.

[@Ch0sen33]

Lex looks happier every video, Looking good Lex!

[@butregenyo_yavrusu]

Great questions as always, thank you for the episode 👌

[@wcskaya]

Teşekkürler Lex.

[@nakamurakatsumoto4855]

Türk var mı türk ?

[@tznalcn]

Olmaz mi :)

[@aydinaltun3816]

var hocam

[@jessepiologo8504]

Thanks Lex! These interviews is key to have Insights.

[@AlDumbrava]

Can anyone point me to resources concerning these amazing advances in camera simulation that was mentioned near the start?

[@AB-ts2xd]

Wow 😲 “brilliant” thank you for this interview I like how he respect competitors

[@evgenizorin5708]

Thank you for doing this Lex. It is just amazing. What do you think about Naval Ravikant on your podcast? it would be mind-blowing

[@sheriffoftiltover]

Last time I was this early, Arthur Samuel coined the phrase "Machine Learning"

[@ianborukho]

Love it when Lex's guests aren't too cool to have fun.

[@unbalancedbinarytree2194]

As bayrakları

[@ethanconnelly8794]

When are you moving to Spotify?

[@roboticsjoe3181]

I think Taskin Padir from northeastern or Greg Fischer from WPI would make for other great robotics discussions. I've had the pleasure to talk and work with them and Sertac. All great researchers.

[@invgreat5608]

Nice, thanks!

[@serbrad6426]

it'ssss awesome!!!! Great time here!

[@dancingfrogsxb1276]

Lex, you need to step up and fill the void Joe's gonna leave in YT, great podcasts

[@garthwoodworth3558]

Sentac is obviously a smart person. When you asked about timelines, his answer was anchored around the concept of technology gaps. He says those are fundamentally unpredictable. He says Musk predicts them. Then he concludes, basically, Musk is predicting the unpredictable. Ray Kurzweil accurately predicted the solving time for the human genome. I think the reason for this conflict of understanding is that Sentac does not have an intuitive sense of exponential change. In fact, humans are basically programmed to intuitively predict in a lineal way not an exponential way. Musk and Kurzwell make their predictions because, unlike the vast majority of people, they do have an intuitive exponential sense this way. But then of course Musk is usually too optimistic. This is because the “sense of exponential change” is not as accurate as the lineal sense people are accustomed to.

[@Taygetea]

Towards the end, one of his real-seeming timeline guesses for mature systems that can use cameras only was *fifty years*. like come on dude.

[@KaraNodrik]

You rock my world!!!! Love you man

[@xXIceShowerXx]

Asin bayraklari

[@Pestbringer89]

As bayraklari

[@poyguls7493]

Talking about air and road many people are missing the opportunity in ships and boats. They already come equipped with expensive lidar and radar. Also a captain costs more than driver or a pilot.

[@soleilluz1254]

Does someone have some Reading Material, or source recommendations for "perception in computer science." ? Thank you

[@woodandwandco]

Look into convolutional neural networks. They are the systems on which “perception” equations or matrices operate. Basically, the camera captures an image, the image is scanned at full resolution, half, quarter, etc. until your image is just a single pixel. At one or many layers of abstraction, the data created from the original image is compared with the layers of data from a large set of layers data of relevant images to predict the contents of the image, the distance of the objects in the image, etc. This is combined with data from radar and laser scanning of the surrounding environment, and the data is compounded and helps produce much more accurate distance and object size measuring. I hope this answers your question.

[@alidemirel8800]

Saygilar Sertac Hocam. Almanydan Selamlar.

[@promptstories]

It would be great if you got Noonian Soong on your podcast.

[@barrymiller99]

Mechanical things break. When they break, they fall out of the sky. Raining metal.

[@nburakovsky]

Sertac is too close to Serac, anyone who has seen Westworld should be worried lol

[@prohotshot1]

hhahaha

[@arasimo825]

Westworld sertac

[@alpha.wintermute]

Setrac is working on the right set of problems for success in his field

[@luvbugs22]

14:31 something is definitely off in THIS video

[@sawyerw5715]

Autonomy versus sustainability... Once you have effective autonomy and prove it safer than human driving, it can only lead to banning humans from driving (with some allowed exceptions). But even before and at the early stages of introduction, autonomy will by definition be sustainable because it will save human time a very valuable commodity.

[@laugh-track-matt]

neat episode buddy . dig your show . cheers yo #funwithbrainlesions #beercuresMS

[@drzecelectric4302]

Love this one. Especially after watching Westworld

[@wuwv-m8h]

so what should we expect ? to have thousands of objects flying in the sky above us ? The blue sky obscured by all that opacity ? How could we watch the sky without having an IFO in the screen ?

[@luvbugs22]

Oh how very clever these people are! Utilising every bit of space possible is advancement!? I beg to differ. We are in an age where the cerebral cortex is dominating, while the heart sits trapped in a cage 😓

[@captspeedy1899]

Do Charles Elkan!

[@SyntaxErr19287]

Should address the UFO videos lex

[@Luzeon]

I have cash app. I love it.

[@siyn007]

Optimus Drive > Optimus Ride

[@theaquarian5849]

...And Robots that climb on rocks.

[@woodandwandco]

Sertac Hard Carry

[@ShaDoWworldshadow]

Great question let me tell you this and i will get to that....

[@Sedancek]

👏🏻👏🏻👏🏻👏🏻👏🏻👏🏻👏🏻👏🏻

[@slick95112]

Is he Turkish or Persian?

[@ai-ur5uv]

Turkish

[@deba4748]

Let's agree on human here. I think those other two labels are there to describe nations, much less to describe a human being.

[@WTFSt0n3d]

we are taking a lot of tangents today welcome to the AI Podcast

[@sawyerw5715]

Compute power coupled with precise reckoning will dominate the application of safety in the air. Think about hyper precise location (you know within an inch where all objects are with appropriate margins for dynamic objects...e.g. tree limbs in the wind). Now, couple that with real time tracking/simulation. Automatic flight control can take advantage provided corridors (volume lanes in the air). Anyway, rules and constraints coupled with precise location and margins of error, is not that compute intensive. If every vehicle in essence is coupled and has its own synced controlled flight, safety should fall out. We could probably do it with today's technology, but it will get easier and easier as compute power increases. AI's can invent the necessary rules and ensure safety margins.

[@furkan.inalcik]

👏

[@Mathieu_Fresco]

I bet your guy is very smart but please send him back to physics 101. Lifting an object vs rolling an object is a 10 fold increment in energy consumption. Our society is starving for energy. Imagining a future with individual flying cars is just crazy. Only the richest Manhattan citizens would dream about it.

[@crackjack7402]

Lex pls bring Stanford's Robert Sapolsky

[@antonio.7557]

i love all the topics discussed here, but the guest is not really knowledgable about most of those high level questions. for example he doesn't understand economics/business but tries to explain and predict things that can only be explained from an economics/business perspective. I'm sure he has some extremely good technical knowhow, but unfortunately the conversation never got very technical

[@marwaeldiwiny]

I agree with you, of course lex is doing a great job, but people are exaggerating maybe because of ignorance and not even trying to think critically for improving.

[@markzaborniak1080]

Why not fake that autonomous vehicles have a human driver, perhaps with a hologram.

[@ai-ur5uv]

You should invite David Sinclair, He is amazing. thank you lex

[@philsburydoboy]

Unfortunately I don't think David does much with CS/AI, and although his work is highly relevant to CS/AI, he has not explored that. The work he is doing in genetics do have a lot to do with very general reward functions and are related to long term memory, but he hasn't really explored that. I'd worry that Lex and David would spend an hour on the verge of having a really interesting conversation, but couldn't quite bridge the gap between their respective fields any more than David already has on JRE or in his own podcast.

[@snackentity5709]

woa 6 seconds ago

[@arasimo825]

Why we see fly car ? I think that we see in next 50 years.

[@willwalshe1314]

Get callen on the fucking show. you have genius after genius....you could have christ on the podcast or einstein but how many of them can make you laugh.

[@vikrantsingh47]

Flying cars is a STUPID idea. Period.

[@0day694]

Turkish pushy

[@myassingh]

Pretty boring conversation.

[@burkebaby]

One of the best intellectual podcasts around. Thanks so much Lex!