Andrej Karpathy: Best IDE for programming | Lex Fridman Podcast Clips

Lex Fridman Podcast full episode: • Andrej Karpathy: Tesla...
Please support this podcast by checking out our sponsors:
- Eight Sleep: www.eightsleep.com/lex to get special savings
- BetterHelp: betterhelp.com/lex to get 10% off
- Fundrise: fundrise.com/lex
- Athletic Greens: athleticgreens.com/lex to get 1 month of fish oil
GUEST BIO:
Andrej Karpathy is a legendary AI researcher, engineer, and educator. He's the former director of AI at Tesla, a founding member of OpenAI, and an educator at Stanford.
PODCAST INFO:
Podcast website: lexfridman.com/podcast
Apple Podcasts: apple.co/2lwqZIr
Spotify: spoti.fi/2nEwCF8
RSS: lexfridman.com/feed/podcast/
Full episodes playlist: • Lex Fridman Podcast
Clips playlist: • Lex Fridman Podcast Clips
SOCIAL:
- Twitter: / lexfridman
- LinkedIn: / lexfridman
- Facebook: / lexfridman
- Instagram: / lexfridman
- Medium: / lexfridman
- Reddit: / lexfridman
- Support on Patreon: / lexfridman

[@LexClips]

Full podcast episode: kzbin.info/www/bejne/mZXMdWBvgrKjmJI Lex Fridman podcast channel: kzbin.info Guest bio: Andrej Karpathy is a legendary AI researcher, engineer, and educator. He's the former director of AI at Tesla, a founding member of OpenAI, and an educator at Stanford.

[@user-vs7cw2rg7r]

Any chance of taking to chuck Moore?

[@remarkpainting]

The 'lazy programmer' problem is the same problem with 'almost' self driving. If you not actively driving, you are not really able to just 'jump in' when there's an emergency, because you've not been 'following along' so to speak. But I think Copilot will become my favorite tool, especially as I am, by nature, a lazy programmer.

[@satyamARAS]

I use all.

[@johndinsdale1707]

Lex, your interview style is the best as a cloud platform architect you ask the questions I would but you have access to the greatest minds of our generation. You are the greatest resource on YT, please always stay humble, you are my hero👍

[@nonefvnfvnjnjnjevjenjvonej3384]

if you need raw cash reply to this comment

[@ex1tium]

I started using ML tools in my programming 2 years ago and ran Tabnine + Copilot simultaneously for few months. Then I noticed Tabnine contributes way less to my code than Copilot so I dropped it. It's really fantastic for anything that has patterns and sometimes when you first write a comment it will take a look at it and offer suggestions. I don't know why it doesn't always work with comment first workflow but it will catch the meaning what you're probably planning to do pretty fast. Sometimes it straight up saves a visit to stackoverflow or google. VS Code with SSH remote is awesome so is LiveShare feature. Programmers or anything to do with creativity will not be replaced by ML not until a true AGI is birthed, what happens after that is anybody's guess.

[@EvanZamir]

I have the exact same setup. VS Code running on a Mac but remotely connected to a Linux instance usually on EC2.

[@doit9854]

Where my VIM gang at?!

[@sunnybeta_]

🙋‍♀️

[@nononoleavemebe]

Vim in VScode gamers sound off

[@gcatmeower]

VIM in Visual Studio/intelliJ/Pycharm/VSCode. I like productivity

[@poulticegeist]

Does evil mode on emacs count?

[@gregmcgreggor7543]

VIM everywhere i go

[@coldham77]

I love that 32,000+ people are interested in what someone uses for their IDE. Beautiful.

[@Coldestadam]

I love Copilot, I agree that it is very good at finding relationships in my code to suggest code after giving a comment of explanation. I have my first software job out of college and I purchased copilot before I started because I just loved using it, but I’m afraid it will make me a bad programmer. It saves me a lot of time day to day, which I think right now gives me more value than the thought of me not being the best programmer.

[@rdean150]

You're riding with training wheels.

[@Celdorsc2]

I still use IntelliJ for Java and PyCharm for Python. I write in LaTeX so both apps integrate LaTeX via the same plugin. For everything else I use Emacs and NeoVim, although LaTeX is also extremely well handled by latter two apps, as well.

[@kyrgyzsanjar]

What plugin you use for latex?

[@Celdorsc2]

@@kyrgyzsanjar It depends on the app. PyCharm/IntelliJ: TeXiFy, Emacs: AUCTeX, NeoVim: VimTex.

[@skylazart]

Additionally, if you’re working with python, use virtual environment and Pycharm integrates perfectly with that env

[@animanaut]

have not used copilot yet, but one thing worries me: the training data set. if the vast majority contains, lets say 30 years worth of legacy, old c++, does it help with changed paradigms and language constructs? i see a case for boilerplate for notoriously boilerplatty languages or the mentioned copy/paste/modify but for everything else?

[@DriveandThrive]

0:22 For me a triple monitor is the best. I'm so used to three monitors now its so painful when I'm forced to use only a laptop. If you have the space and can afford three monitors its definitely worth it. (I secretly want a 4th, a TV, above my setup and I keep my phone as even an additional screen below my main monitor. For productivity?! Not really lol)

[@pranaysharma2055]

I have tried using multiple screens (Laptop + 1 External) but found that I was only using one screen effectively. And that I had to now switch control b/w 2 screens instead of 2 applications on a single screen. I am confused as to how multiple monitors increase productivity for programmers. As a human, we can innately type/read/work on the contents only on a single screen. So how exactly is having multiple screens beneficial? (Unless, ofcourse, you're monitoring anything where u have multiple dashboards or items to be looked at.) Just looking for some insights on how it is helpful. Tx.

[@jrr2479]

@@pranaysharma2055 My preference is four or five identical monitors (1440p) in portrait mode, which is awesome for me. I can for instance have [ browser ] [ browser debug ] [ java debug spans 2 or 3 ] which lets me step through with breakpoints in both web and server side without switching between windows. Just an example, but feel slightly handicapped with just the one monitor. 1< 2 < 3 < 4 < 5 though the benefit of 3, 4 , 5 declines.

[@ex1tium]

I have 2x 34" ultrawides stacked on top of each other. 2x 1440p monitors on the sides in portrait orientation and laptop arm for X1 Carbon on my right side that I connect to remotely with VS Code remote SSH. Working from home was the one blessing from pandemic.

[@Finnspin_unicycles]

@@pranaysharma2055 I've found 2 to be super useful in engineering tasks. Whether I'm drawing something in CAD or programming, there is usually something I need to reference - dimensions, some math equations, interfaces etc. It's so much better to have them open the whole time than switching between screens (especially if you need to copy something over). Sometimes 3 would be nice to have more than one document open as a reference or dedicated space for a browser or file explorer, but usually 2 is enough.

[@thomas2446]

​@@pranaysharma2055 I think most of it is a mental/workflow help. Best example is if you have 3 windows open and you alt+tab between them, you are going to have to use brainpower every time you switch windows and look at which one you are switching to, with another monitor you can just put it there and look. People can't look at more than one monitor at a time, it just lightens the load of having to think about how many times to press alt+tab. I went from 3+ monitors to 1 and added keybindings to virtual desktops and my workflow has stayed exactly the same, I just press super+[num] instead of moving my head.

[@claus7555]

Copilot is fantastic, but you need to create a separate profile or deactivate other extensions. It didn't work very well with many extensions enabled on my machine. I usually work on a Windows 10 machine with the Windows Subsystem for Linux enabled. This setup works for most tasks...

[@denisquant]

When he say that he ssh to a cluster is the same as ssh to a virtual machine? Or is there nuances?

[@TheRiquelmeONE]

vscode is my favourite, but i need to use jetbrains IDEs right now and they are nice too.

[@bettybunbun9664]

I use Pycharm from Jetbrains for Python. Haven't used copilot yet, but it looks promising.

[@dcx45]

Works with copilot, it's great.

[@hawkdykes9054]

love pycharm for django dev

[@bettybunbun9664]

Started copilot today. Its pretty smart.

[@jonintc]

I transitioned to C++ at work and downloaded Clion because I was so happy using Pycharm for many years.

[@anon21341]

pycharm kills my RAM

[@alexbecar977]

Anything with vim bindings is decent but imo jetbrains editors are the goat

[@74Bagas]

this is my cup of tea

[@nroose]

As far I as am concerned, it's always been true that what to make is harder than how to make it. Software teams struggle with this and I don't think that is something that AI would be good at.

[@beto.aveiga]

Yeah... Good luck debugging that 😁

[@balaji-kartha]

Brilliant! And if you guys were hesitation to predict the future, that was because you guys know too much of that !!

[@plica06]

I like those real geeky questions... What IDE do you use? As a hobbyist programmer I'm really interested to know what set up the pros use.

[@sandwichtube]

Hey I’m using vscode as well.

[@d_b_]

4:15 generative adversarial programming?

[@user-sl6gn1ss8p]

a "copilot" for testing sounds like it would be nice

[@Nil-js4bf]

I use VSCode for Typescript but I go to Intellij when I need to work with Java and Kotlin. The different keybindings are annoying, I try to make it as similar as possible with the VSCode keymaps plugin. Intellij suffers from too many options all over the place and there's either too much bloat in the software or maybe it's just Java's ecosystem but I actually feel way more input delay with Intellij. It made me realize that this is what Primeagen must be feeling when he says VSCode's input lag kills his soul so he uses Vim. Not to say VSCode is free from luggishness when you have a large project with lots of complex typescript functions - would be great if TS server becomes faster. Copilot is great but I would prefer prompts to appear faster. Sometimes I wait and nothing appears. Maybe it's the latency to Australia. As Karpathy says, it's mostly useful when there's some sort of obvious pattern going on - copilot is great at continuing it. It suggests 1 line at a time for me and I'm guessing there's a way to make it autosuggest an entire block but I'll need to look it up. It's also been useful for me when I work in Kotlin/Java which I don't consider myself fluent in. It's been super handy at introducing me to new APIs in that language.

[@hypnotico7051]

That's one of the beauties of VS code. It can work with just about any project and you don't have to relearn key binding just to use a different language.

[@budgetaudiophilelife-long5461]

THANKS LEX ,VERY INTERESTING 👍😎💚💚💚

[@ckaspersen]

Holy balls that guy talks fast! Loved this episode

[@DuneKraftwerk]

He give you the answer right at the beginning no need to ask again. Vs Code

[@FernandoLuizAvanzo]

I watch that and I am starting think that in the future we can programing like the iron man interact with the Jarvis or Friday in the movies

[@RockTo11]

VSCode is horrible for debugging. I use it for C a lot of the time, but the debugger cannot do good formatting or layouts of data. It's just awkward - and slow.

[@TimothyFish]

Eclipse unless you are developing for the Windows GUI, in which case, Visual Studio. For Mac, probably Eclipse, but who really wants to develop on Mac? In my opinion, the Unit Test features of an IDE are much more important to which IDE to choose than the code writing features, since we spend more time testing than actually writing code.

[@MikeEnRegalia]

Eclipse? Never, ever again 😂

[@hypnotico7051]

You're really showing your age with this one. I find that it tends to be older people that use eclipse. And Mac is probably the most popular development machine. I would use it myself if their screens didn't give me a headache.

[@christopherross8358]

I love when people say you are showing your age; what they don't understand is you are showing your experience. 🖥💾 Been in this game since the Tandy TRS80 Son 🧃

[@hypnotico7051]

@@christopherross8358 do you want a cookie or something?

[@TimothyFish]

@@christopherross8358, I learned to program on the TRS-80. They were great machines, in their time.

[@remarkpainting]

Also worth noting when thinking about the luddite view (and for those who think the luddites are wrong once again), AI is growing in strength and ability at 10X per year...much faster than Moore's law...so it may well get to the point pretty soon where programmers are more akin to the human managers of automated factories...our job will be to keep the AI working.

[@TheControlBlue]

That's bad?

[@higgins007]

Vim. The only IDE I've found to be tolerable after 20 years as a c/c++ programmer is QTCreator. But I still find myself spending most of my coding time in vim, all other IDE's, no matter how I customize them, end up just getting in the way and frustrating in the end.

[@hwstar9416]

im more of an emacs guy because I like my gui.

[@higgins007]

@@hwstar9416 About 5 years ago after finally reaching the end of my patience with the various IDEs out there, I did about a weeks work reading up on and watching videos about emacs and vi. I didn't want to take the time to learn them both properly to make a decision, just wanted to pick one. Vim swayed me mostly because of how lightweight it is and how ubiquitous it is across every environment I ever find myself in. I was using gvim for Windows for a while, but the new linux subsystem is a godsend. Just open the ubuntu terminal and go directly into vim. It's great. I've grown to love the vim mode based interface but I don't get into the editor wars, emacs seems to have a lot going for it too.

[@wardm4]

If someone answers anything except Vim, then they are pretty much objectively wrong. Vim is the most hyperefficient environment out there, and if you use something like neovim with modern plugins, it can do absolutely everything VSCode can do.

[@hwstar9416]

@@wardm4 emacs go brrrrrrrrr

[@higgins007]

@@wardm4 personally I shy away from plug-ins. I draw the line at a vimrc file so I have a consistent setup basically everywhere. New Os or reinstall, I just copy 1 file and I’m ready to go.

[@skylazart]

Pycharm my friend. Vscode is good but requires too much setup. Pycharm is ready to go. Two steps and you’ll be running and debugging your python code flawless… I used to love emacs but those modern ides are in another level. Of course, for things like C kernel land code, even vim is just perfect.

[@ahmadchamseddine6891]

I only use VIM

[@abhishekkumarbiswas3365]

when he said 0:31 SSH to cluster it sounded like "history repeats itself" as in 1970s people like Bill Gates etc used teletype terminals to code in DEC PDP-10 or something, Cloud computing is like time moving back

[@marcellkovacs5452]

The thin-client paradigm is not exactly new

[@abhishekkumarbiswas3365]

@@marcellkovacs5452 thats right, its just irony that people developed miilion times Powerful compute chips for offline Personal usage than again Online computing still an advance trend

[@lylestavast7652]

emacs, for the win ! (I'm still using vi...)

[@jasongodmere9882]

It is certainly an opportunity for competent programmers to be even more productive in the near-term. As for the long term, what i can say is there will be no shortage of problems both minor and existential for us to overcome. We need problems to provide us purpose and to command a high standard from us so that we do not regress as a species. The more capable we are, the greater our problems. It's easy to forget that disaster is born from a misuse of potential, but that is not to say the potential itself is at fault. For better or worse, we must learn to adapt ourselves to this new domain of human endeavor so that its energy is utilized to sustain and expand our experiences instead of detract from them. "With great power comes great responsibility" Ben Parker - Spiderman

[@psgbjj]

JetBrains IDEs are the best IMO

[@rl_aaaa]

Yeah. You can do so much without leaving the ide. DB access, sending requests, etc. And I know you can install extensions to vscode but from my experience they are never as polished as build-in jetbrains features

[@SumoCumLoudly]

After the 2 hours indexing

[@sh1sh1n11]

Copilot X now includes all things (and more) that were the supposed future of it just 6 months ago. That's wild.

[@nroose]

I use Emacs as well!

[@straightup7up]

VSCode with Copilot is killer.

[@josho9910]

vs code is actually fast... but hey, I haven't ventured out of scripting languages since Programming fundamentals I

[@surfingbilly9654]

Jetbrains IDE vs VScode vote and discuss below 👇

[@martinlutherkingjr.5582]

How do you disable all suggestions like intellisense and all that stupidity temporarily in VS code?

[@surfingbilly9654]

by uninstalling it and downloading jetbrains IDE instead.

[@federerfanatic]

Copilot for math would be nice. Perhaps it exists?

[@MichealAEdwards]

play it at .75 speed this makes Andrej so much easier to understand Lex sounds a bit dim though lols

[@moomoocow526]

Alternatively, listen at 2x and be a gen z KZbin viewer

[@Paretozen]

Alternatively, use AI machine learning and produce a transcript of the conversation.

[@Jordan-dr7zi]

custom neovim setup

[@chriswarren-smith62]

Use tramp in Emacs to remote edit over ssh

[@alfellati]

VsCode for sure

[@dirkbirot2155]

I need a good cs code tutorial

[@SBqwerty]

Polynomial time verification of a solution is NP Complete not NP Hard :D

[@badtingzz]

Notepad++ like an OG 😏

[@Kenbomp]

Vscode isn't really an ide. It's just a text editor with a fancy clipboard. Useful yes but nota debugger.

[@hypnotico7051]

It has a debugger I use it all the time for c++ and flutter.

[@developerjas]

I am all for Jetbrains!

[@abyzzwalker]

Open Vim in a vscode terminal, then use vscode 100% of the time.

[@kbsanders]

JetBrains IDEs

[@AlanTuringWannabe]

I feel like copilot will have a point where managers will try to replace human programmers and then end up with horribly buggy code that causes some massive financial problems and they will have to hire people again.

[@SJ-eu7em]

I dont think financial institutions will do that in next 10 years, maybe some startups...

[@luizs.f5305]

I feel your pinky pain dear Lex (0:57), but remember: where there's a will, there's a way out my friend... 😅

[@ah64Dcoming4U]

Co pilot will be great when it can do test driven development

[@moomoocow526]

It can. That's how I use it now

[@DriveandThrive]

3:02 Yeah it will become better and better for helping programmers but I doubt it will ever fully be able to replace programmers. Not unless some general artificial intelligence emerges and then hey everyone will be out of a job haha

[@hwstar9416]

compilers aren't even smart enough to thoroughly optimize the code you explicitly wrote. Something like co pilot won't realistically replace programmers.

[@velvia7880]

What if there was a co-pilot to co-pilot, that kept checking it.

[@kawingchan]

Agreed on VSCode. Lightweight + copilot are the killer features for me. It is really a feat of engineering to be that fast and light at the same time.

[@weirdo911aw]

vscode isnt really that fast nor lightweight. neovim with LSP, treesitter, and DAP is faster and lighter. Though setting it up is definitely not for the faint of heart 😂

[@DriveandThrive]

@@weirdo911aw well and the learning curve.

[@II-ii2um]

Fast and light? Vscode? Lmaooooo

[@bigpickles]

Vscode sucks for MC programming.

[@cristianstoica4544]

What's lite in vscode? The icon? the shortcut? The word itself?

[@kv6257]

Sublim Text 3 = Best of All

[@Daniel-pc2ov]

VSC

[@Kim-by5uy]

Vscode for life

[@iivarimokelainen]

pycharm for python, clion for c++, webstorm for webdev

[@wavesnowaves]

PyCharm CE here..

[@SteeleMan223]

I had a involuntary physical convulsion when Lex said EMACS!! I learned C++ on emacs and it hurt. I loved their conversation on Copilot. It is like having a conversation with your code. I really enjoy being able to type an intent in a comment to see what Copilot recommends to see if it lines up with what I would do.

[@kaibe5241]

Copilot is the most incredible development in programming over the last 30 years.

[@InsideAlps]

3:50 Andrej‘s laugh sounds the same as Elon‘s. Or is it the other way around?

[@markmalonson7531]

Wow!

[@DavidOkwii]

Until I see an IDE that instead of throwing abstract and often vaguely described errors and exceptions in the code that programers then have to Google and filter through Stack overflow before they get to the right solution to fix their code, I am not moved at all. Code autocomplete and suggestions Is one thing, but debugging is another monster. As far as I know, there's no intelligent IDE that handles the latter well enough to increase the programmer's productivity 10x. That's why Google + Stackoverflow are still an indespensible tools in most programmer's everyday workflow. Big opportunity for AI-driven code debugging here.

[@nerdworld8211]

Humans will always need to hit the breaks for automation or A.I. letting a software loose is akin to letting a dog follow its nose.. sooner or later it will get distracted. Always keep your dogs on a leash.

[@sungam69]

That's how government thinks about it's citizens

[@aniellodimeglio8369]

Whatever IDE doesn’t have a Microsoft logo on it.

[@amzxa7574]

"It's not just a AI problem, but UI/UX" 6:20

[@mkjyt1]

holy shit it's been just a year ago.

[@mattgoodmangoodmanlawnmowi2454]

vi heck yeah

[@a2ashraf]

The best ide is from intellij. The best!

[@kamikaze_jb]

Nothing beats jetBrains, sorry to say :kek

[@lukaswalker2342]

vs code facts

[@vascoguerreiro341]

Andrej Karpathy is very smart

[@yaghiyahbrenner8902]

Andre is correct - Those who does remote work into clusters know this technique, applies to Raspberry PI development as well.

[@somechrisguy]

Good for hotfixes on production :D

[@yaghiyahbrenner8902]

@@somechrisguy 100%

[@ruiloureiro2601]

Thank you for validating Yaghiyah

[@souradeepgoswami4654]

Jupyter Notebook gang wya On the rare occasions I need to do actual programming, gotta go with VSCode (Mac life)

[@rustyshackleford2469]

Collab better🥱

[@surfingbilly9654]

what do you mainly do? data analysis or something?

[@souradeepgoswami4654]

@@surfingbilly9654 Yep.

[@josemonge4604]

VS Code is what works best right now for professional development. Its features are incredibly useful like remote access to ssh servers, containers, WSL,etc. Copilot seems to be the future of dev honestly. Most of the older IDEs are getting behind cause of the lack of modern features.

[@lolledopke]

Lex: What's your setup? Andrej: VSCode Lex: What's your favorite IDE? Andrej: VSCode. It's has really nice copilot integration Lex: Do you use copilot? Andrej: ARE YOU EVEN LISTENING?

[@devon9374]

😂😂😂😂

[@dotnet364]

lex just cant let the guest talk 99% of the time. andrej is the star

[@frangalarza]

Lex, give VSCode a go. If you program on a strongly typed language, it does half the coding for you and you never have to leave the IDE to check documentation. Things have changed!

[@warnaoh]

I think you underestimate how hard it is for someone used to either emacs or vim keybidings to go to something else

[@Reibaku]

What does half the coding for you, vscode or copilot? Because you can easily integrate copilot on emacs or any editor for that matter and there is nothing special about vscode other than the fact vscode and copilot are both Microsoft products so they have first class integration (minimal to no setup needed by users)

[@frangalarza]

@@warnaoh I get it that change is hard. But to stay relevant in tech we need to embrace change :)

[@frangalarza]

@@Reibaku Copilot is in a whole different level, but I’m talking about VS Code and some free extensions. You barely have to type a few characters of the variable you want to reference and it picks it up for you, does the import and everything. Also tells you the properties of classes you’re using and shows the documentation, all in the ide without having to leave your environment. VS Code has shortcuts too, nothing exclusive to emacs :) you can code without ever touching the mouse if you want

[@r4s3]

@@warnaoh I'm an ex-vim user and vs code has a top-tier plugin for vim keybindings. That is not a problem. I'm sure there's one for emacs keybindings too.

[@xAngel03]

Well, we do right code to test our code, don't we?

[@albeit1]

The demand for programmers will start dropping when the number of things that can be implemented stops being infinite.

[@hwstar9416]

"stops being infinite" is a contradictory statement.

[@albeit1]

@@hwstar9416 that’s why it’s going to be a very long wait.

[@DIN_A8]

Get the Primagen on the podcast .. pronto .. err i mean blazingly fast !!!

[@iLaRaemusic]

Skinny Chris Pontius!

[@TheCrusaderRabbits]

NotePad

[@rickymort135]

My setup is identical to his, except my monitor is 32 inch not 27 inch.... I'm not saying I'm superior.... but come on 32 > 27

[@woolfel]

I tried copilot for a few weeks and it's "so so". If you want to reduce boilerplate typing, copilot is useful. For what I do, it's not that useful.

[@8booksamonth]

Where is “Skip Ad” button?

[@Muaahaa]

It disturbs me a bit that Andrej, someone who is part of driving this sort of tech into the future, is not willing to look the future he is helping build in the eyes and talk about it with Lex. Manufacturing jobs hardly exist the US these days and this work is intent on outsourcing knowledge work in a somewhat comparable way (although to machines instead of overseas). We are on a path increasingly favours owning to working, but we all know that ownership is very centralized. We are at risk of leaving behind most of humanity if we don't very consciously combine automation breakthroughs with policy and ethics.

[@xavierreigneau41]

IntelliJ for Java

[@IvanRandomDude]

Even for other languages. I use IntelliJ for react and angular apps too and it's much better for me than VsCode

[@airman122469]

Neovim - for everything not .NET For .NET stuff - Visual Studio

[@williamng378]

Kite is like co pilot for free

[@anonjohnnyG]

VIM