Andrew Ng: Deep Learning, Education, and Real-World AI | Lex Fridman Podcast #73

[@lexfridman]

I really enjoyed this conversation with Andrew. Here's the outline: 0:00 - Introduction 2:23 - First few steps in AI 5:05 - Early days of online education 16:07 - Teaching on a whiteboard 17:46 - Pieter Abbeel and early research at Stanford 23:17 - Early days of deep learning 32:55 - Quick preview: deeplearning.ai, landing.ai, and AI fund 33:23 - deeplearning.ai: how to get started in deep learning 45:55 - Unsupervised learning 49:40 - deeplearning.ai (continued) 56:12 - Career in deep learning 58:56 - Should you get a PhD? 1:03:28 - AI fund - building startups 1:11:14 - Landing.ai - growing AI efforts in established companies 1:20:44 - Artificial general intelligence

[@dayanandak4667]

Thank you very much

[@zeitgeisttv5312]

The reason why hand writing is fundamentally different and more powerful because you are in the act of recalling and creating neural pathways. It's like drawing you are creating something from nothninness

[@avimohan6594]

About time! ( 😂)

[@aheinstein291]

I think you forgot: 1:22:02 How to throw shade at Elon Musk without mentioning his name. Jk, thanks for another great interview!

[@jf9229]

Absolutely loved this one!

I'm just a tradesman painting houses for a living but I stream these discussions in my headphones all day long while working. Even a luddite like me can gain so much from a guy like Andrew Ng - it's a quasi-spiritual process contemplating AI and how it relates to how I think and see the world. Even those not educated in this area ought to take an interest as its so intellectually enriching.

[@jeromedeleon1226]

you’re an inspiration! everyone has humble beginnings

[@josh_rdgrs]

I do construction and I do the same thing lol. Cool to see I'm not the only one.

[@refactoredcodes]

The work you do for money and your knowledge should not have to match. They are two different things. I am a software engineer and I want to learn to paint house. Because, that is a skill and activates different parts of brain. Education is everyones right. And, they should have access to it.

[@simokokko7550]

@@refactoredcodes Well said. Everyone should try to learn as much as possible. And like you said 'job's status level' should not define people. There are smart people everywhere.

[@kattmeating8315]

Bunch of good will huntings over here

[@Reve101]

I teared up when Andrew said “someone allow me the good fortune of helping them a little bit on their path to their dreams”. It restores my faith in humanity when I hear influential people like him with this much humility.

[@prof_shixo]

I have a PhD in AI and I can say that Andrew is THE BEST machine learning/AI educator I have ever seen on the field! The deeplearning specialization is just invaluable for any interested learner in DL.

[@pranav3658]

Hey, is it a Ph.D in standalone AI or is it Ph.D in CS with a concentration in AI? (PhD AI or PhD CS with AI concentration).

[@prof_shixo]

@@pranav3658 Hi, there is no such a PhD in AI as the specialization. Usually, it would be PhD in CS, Stats, or EE with a focus on AI and machine learning.

[@pranav3658]

Sherif Mosaad aah, thanks a lot for the reply! Also, I have an admit into the masters program in AI @ Boston University, AI is definitely what iam passionate about and a Ph.D is definitely a part of the bigger picture for me. Would you recommend I take it or rather settle for a more traditional MS in CS with focus on AI?

[@shravani9106]

@@prof_shixo hey I am 17 still in high school. I did some courses in machine learning and some data science courses.Topics like Neural Networks intimidate me. I wanna ask which major should I pick as my undergraduate degree. CS, electrical and electronics, or economics degree?

[@ivannav]

@@shravani9106 CS

[@shamsuddeen2004]

Whenever someone uses the word "It turns out", I remember Andrew Ng. I love Andrew Ng.

[@Max-lr6dk]

@@99dynasty i will buy it

[@bobblum2000]

@@99dynasty 1

[@re1konn]

@Potato Potato was gonna type the same thing haha

[@s.tahsin.r2288]

yes have heard those before every time a topic came up that Andrew feared might be too much for his students.

[@BingLi224]

recall his lectures

[@TheRobertjoellewis]

I took Ng's class on Coursera years ago. It switched my career trajectory from academic to industry, and spurred my interest in making things. Awesome to see this interview!

[@stanrock8015]

Robert Lewis I’m late to the show and going thru it now but yes. Changing my career direction now

[@unreactive]

Hi, I take the same class. Can you recommend some next course or anything else?

[@TheRobertjoellewis]

@@unreactive I really enjoyed reading DataSmart by John Foreman. I also recommend the website "fast.ai" (I found out from Lex). Finally, there are good courses on specific techniques, programming languages, etc, on how to use ML on udemy.com. Udemy seems more practical, and has taught me how to actually implement some things and deploy them for use in the cloud.

[@unreactive]

Awesome, thanks!

[@Sui_Generis0]

How much is it?

[@danielfirebanksquevedo891]

One of the people that inspired me to do artificial intelligence in areas that matter. Without Coursera I would have not gotten where I am today. Thank you for this conversation Lex!

[@usaintl8456]

Splendid!

[@Lumcoin]

did you finish it? I'm at course 4 week 4 in deeplearning.ai

[@Aesthetic_Euclides]

Is it really that good?

[@dra.adrianadomingosromer4968]

Im a physician from Brazil learning ai and this fine man helped me a lot thank you sir I salute you

[@chaidaro]

27:34 "If you want to make a breakthrough, you sometimes have to do something before it becomes popular". What a humble man :)

[@aishwaryamuchandi9005]

He's the best teacher I have met so far. He teaches all the concepts to its very core and many times even predicts his student's doubts and clears it(really felt as if i was into his class where all my doubts were getting cleared) . His teaching made me realize my passion for AI, ML which decided the trajectory of my career. He teaches such complex concepts in such a simplified way (that's the beauty of teacher).At one point of time I could literally visualize statistics making my foundations clear(especially gradient descent) . It will truly be my fortune and blessing to ever meet my mentor in person. Thanks Lex Fridman for this video where we all could know more about Prof Andrew Ng.

[@joshryan4387]

I currently work as a computer vision engineer. I got hired having only a BS in Math and zero ML experience. My first assignment was to take Andrew's ML/DL classes on Coursera. Invaluable. Thank you!!

[@seetsamolapo5600]

Would you still recommend it for beginners today?

[@Michael-Gill]

As a GenX'er I enjoyed this interview so much. It made me actually feel like I was experiencing the internet we were promised decades ago. A well thought out and intelligent conversation that, in the end, leaves the viewer in a state better than when they first pressed the play button. Well done.

[@zeitgeisttv5312]

53:30 Andrew's Recommendation on how to learn more deeply with handwritten notes

[@Sui_Generis0]

Handwritten notes is better than typing but I thought that is not surprising. That being said, taking notes In itself is not that good for revision/recall. Active recall and spaced repetition are the best for that

[@aegystierone8505]

I have to agree with this, even while learning programming, writing things down actually helps a lot.

[@adognamedsally]

I found this basic technique very useful for studying kanji while learning Japanese. My theory at the time was that the extra effort I had to expend was forcing my brain to focus more on the content rather than going into autopilot mode. However, I also found that intervalled repetition was a big part in the learning process.

[@datasciyinfo5133]

Agreed. Active recall (trying to answer own questions with the solution covered) and spaced repetitions are best. But trying to summarize a point in your own words in almost as good. I think Andrew was pointing to that aspect.

[@Oblivic]

You’re making these vids almost as fast as I can watch them! Thanks so much my favorite podcast and my favorite thing on youtube.

[@TechOutAdam]

This man got a great voiceover career available at anytime.

[@vijayabhaskar-j]

Both are wearing their iconic dresses! XD

[@BasharAlkhalili]

Those are their super hero suits

[@matthewchunk3689]

@@BasharAlkhalili brilliant people seem creatures of habbit. what to wear is not just a distraction, it's irrelevent to them (i'm thinking of einstein in those effeminate sandals)

[@MiroslawHorbal]

Thank you so much for making this available Lex. Andrew literally changed the direction of my life with his Stanford ML course and subsequent work with Coursera (which happened to introduce me to Geoffrey Hinton's deep learning course). His work ethic and drive to help the most people has helped reshape the face of education and I don't doubt it will leave a lasting positive impact on this world.

[@arunramji]

Andrew NG has lot of fans in INDIA 😊

[@pradnyachaughule7709]

Thanks Lex. The conversation is quite informative. Andrew NG is the one who introduced me to the world of Machine learning through Coursera few years back. I think it takes a special kind of expertise to make complex things sound simple. Andrew NG truly has done a great job at explaining basics of ML to all of us. He truly is the father of Machine/Deep learning.

[@iirolenkkari9564]

I have taken several of Andrew Ng's courses. I have thoroughly enjoyed them and learned so much. He is a great teacher and a very likeable person.

[@GovindKumarMaliLucky]

Andrew Ng is my Guru.. This is first podcast I listed fully in a silent room

[@jahyegor]

Единственный подкаст, который я могу слушать постоянно. Лекс, спасибо за первоклассный контент! В сети вряд ли найдется другой такой же впечатляющий источник философского анализа темы искусственного интеллекта. Как говорится, instant classic )

[@user-so7ix1pj7h]

Andrew Ng is really productive in AI area. His courses of deep learning is my first AI course. It is really helpful. Helping people working great in one area makes people feel happy. do something useful for other people. Thanks Andrew and Lex.

[@mmughal]

This one I will listen full!

[@jentazim]

Thanks for being considerate in the way you do ads. Much appreciated.

[@zeitgeisttv5312]

Andrew Ng and Lex Fridaman voices are so soothing

[@eidios6871]

I've been waiting for this!!! Thanks bro!

[@thecanopenerpodcast8575]

Lex, thank you for educating the world for free, I am grateful beyond belief.

[@Niki007hound]

Fantastic interview. I took Andrew's ML course and am still deeply impressed by his pedagogical abilities. He is very observant and masters the art of passing on his knowledge. What an enrichtment these new distance learning WBT methods are for society! Perhaps the biggest improvement in this still new century for quality of life and fairness regarding access to knowledge and skills. Thank you from a humble admirer.

[@kyrgyzsanjar]

Andrew is one of those people whos impact on the world is impossible to estimate. He's a living legend. Born to be an educator.

[@SudipBishwakarma]

Man I love your podcasts..Andrew Ng is such a great educator. His deep learning specialization on coursera is what got me into machine learning. His Stanford machine learning lecture playlist on KZbin is awesome as well.

[@nurgisaandasbek]

Thank you so much for making this available Lex.

[@sakthiks777]

Andrew Ng is a great teacher, great person, great(to the power of n) to me and my friends. I request this great human being to build systems in healthcare and life sciences that would transform the lives of people around the world, particularly the poor-needy and under privileged.

[@manuelillanes1635]

I'm a psychologist trying to jump to AI, this was my first professor even though he doesn't know about me I'm very grateful for his existence. Thanks Lex.

[@nb8298]

Thanks for having Andrew on. He is above all else very authentic in his journey.

[@manhalrahman5785]

Listening to Andrew Ng is so nostalgic lol I remember how much I enjoyed my first step into AI with his ML course

[@iamhandk]

This is so awesome! Thanks for having Andrew on.

[@hg4875]

Andrew Ngs point about reframing the problem to solve it yourself was extremely insightful. I'm going to try this with my nephews when we make puzzles - I'll show him initially how some things can connect (not all) and have him "reframe it" to solve it himself! - super excited

[@submagr]

Thanks, Lex for this amazing podcast. Thanks Prof. Ng for thoughtful advices. What I liked best - Try to study 2 Research Papers every week, make a habit of something. Think about who would be your peers before joining a team. Thanks.

[@nirajabcd]

Good to see so many of the listeners took up ML/DL courses from Andrew Ng. I am one of them and actually been doing professional work for more than a year. Without Andrew Ng and Coursera, I would have never gotten into ML.

[@hetheas7906]

Andrew Ng is, without a doubt, the best lecturer out there!

[@anandbalivada7461]

This week has been awesome! First Scott Aaronson and now Andrew Ng :). Lex, it'd be really cool if you could get someone working on the theoretical aspects of Machine Learning, like Sanjeev Arora, Ankur Moitra or Costis Daskalakis... It'd be super interesting to see the conversation between experts on two different sides of the same coin; applied and theoretical.

[@johnfunk7568]

Lex, More love to you bud. Enrolled in Coursera and signed up for Andrew's course because of this!!! THANKS!

[@engineer580]

Two of the people that encouraged me to do artificial intelligence are you. Thank you.

[@manbunmath]

I love the part where they talk about handwritten notes over typed notes. The fact that you have to "encode" the information in order to write it down in fewer words [rather than be able to transcribe verbatim when typing] is key. When we encode the data for our notes, we are learning a set of nonlinear transformations which connect our encoded notes and the original, larger resolution, message. In performing such a task, we learn features about the message, thus gaining what we call "a deeper understanding." The brain is a wonderful machine.

[@caijason9486]

Great job. I have been totally inspired by Andrew Ng two years ago.

[@henrycowsert3999]

You've come so far lex!

[@HeisenbergHK]

The best explnation of gradient decent I've ever heard was from this man, Andrew Ng.

[@ramon1f]

Great, enjoying my dinner at the moment. time to feed my brain some information also! Let's go.

[@e-readers]

I really enjoyed this interview done by you and Andrew.

[@bluestacks661]

He explains very eloquently actually! Thanks for the interview, Lex!

[@vegas1854]

It's an amazing time to be alive. I'm fascinated by Auudia's new Vodacast. Perfect podcast compliment.

[@neuroling]

This is a very inspirational interview. Thanks for it, Lex!

[@ss00mm11]

I came from no formal education on computer science or AI, took Ng's machine learning MOOC, and fast forward a few years and now I'm in my 2nd year of my CS PhD with a focus on AI.

[@seetsamolapo5600]

Wait, so you got into CS PhD without doing the CS undergrad?

[@ss00mm11]

I had an undergraduate degree in physics and master's in mechanical engineering@@seetsamolapo5600

[@ryanwickman855]

Amazing to see two great minds talk! Especially Andrew Ng who introduced me to the field of machine learning!

[@imraulemmaka511]

I was long waiting for you to bring him!!

[@nirajabcd]

Andrew Ng was the reason I started doing AI/ML. Big fan of him.

[@carlosvillarreal7989]

Andrew's videos on KZbin are goated. 🐐

[@joyeo2498]

Hands down to Andrew. Great mind with such a down to earth personality. Just love composed and calm vibe that he gives out when he talks as well.

[@sigangsabaglari3606]

Thank you Andrew Ng, you are the best. I'm learning so much from you.

[@ivanpineda258]

This is one of the most impactful podcasts I've heard! Thanks so much, Lex & Andrew!

[@aaditya_ai]

Finally ! Andrew Ng.

[@bakhtiyor_sulaymonov]

Thanks for the podcast

[@AxelC2020]

ok, after watching Lex for for a while I finally enrolled into coursera AI course.

[@kevthedestroyer1044]

yeah deeplearning.ai has two great courses

[@JousefM]

I like all of your Podcasts Lex, but this one will probably be the first one that I watch from beginning to the end! AndrewNg 4 president! :D

[@krasimirzlatev4843]

Nice listening/watching to both of you. Thank you.

[@nimmasoda]

#1:15:00 Ripple Effect #1:24:00 Wealth Inequality #1:26:00 Mistake of Late Realization (Do not regret) What a golden interview it is... So much inspired by his words. We need Part-2 of Andrew ng, after his another ground breaking work. Such a great human-being in Tech space __/\__

[@MrAscetic23]

Fantastic, just in time for my 2hr drive

[@captainhaddock6524]

Andrew ‘don’t worry’ Ng 😀 Really cool guy though, I enjoyed working through the Deep Learning Specialisation a few months back. Surely many others here did too!

[@yunqingma2796]

hahaha...Did the Machine Learning and now doing the Deep Learning Specialization...He always "I know......don't worry about it...It will get better as you go through the programing ass".............but man...the Deep nn ass is damn hard...

[@shawnjames3242]

@@yunqingma2796 hey bro did you finish the specialization

[@romandorosh8473]

This man has pulled some strings of my soul. And it's really motivate me for dive in this field. Thank you, Lex

[@VysakhRemesh]

Thank you Andrew Ng and Lex Fridman

[@mqasemniksefat4202]

I love the guy! He influenced my knowledge and path, as well as many of you, for the better!

[@hillstudios1]

Thank you Andrew and Coursera

[@TheAIEpiphany]

01:01:00 That's a huge piece of advice! And I couldn't agree more. People tend to get attracted to the logo - but the experience individuals have is so broad and ranges from poor to incredible even inside Google, Microsoft, Facebook and all of those famous tech companies.

[@mustaqimkhan6885]

Thank you Lex Fridman for this great podcast!

[@l_a_h797]

Thank you for pronouncing "Ng" at the beginning of the video! His name is everywhere, but it's not easy to find out the pronunciation. Also great questions, and inspiring, insightful answers from Andrew.

[@avinandanbanerjee9568]

no words can describe how much i love andrew

[@thequantartist]

Loved this video, I found it really interesting to hear Andrew Ng draw the analogy of litteracy to data science or coding skills.

[@8adeight]

Ng's accent is completely mesmerizing. I feel like I'm learning just listening.

[@dalchemistt7]

Woo-hoo....It's Andrew Ng. My 3 most admired virtual teachers are Prof. Strang, Tsitsiklis and Ng. Two have been here and only Prof. Tsitsiklis is remaining now. Thanks Lex.

[@chuckyandrewson3441]

Lex, I agree 100 percent on the writing by long hand. I became a writer in prison, inspired by none other than himself Mr Henry Chinaski. First few years were pen and pad, then I lucked into an electric typewriter which was still sufficiently analog enough to get these same results in relation to retention. Funny how these basic principles of simplicity or back to the basics do in fact hold their own, whether it's the stem folk implementing them or the proletariat. Idk, I really enjoy what you do. Keep it up, please. Na Zdorovie!!

[@Ramlingamr]

Fantastic! What I like about your casts is the choice of people to talk to and meaningful line of discussion. They elevate our understanding a little bit, looking forward to every episode!!

[@thienphanphuoc4824]

Prof. Andrew Ng is a very respected man with his smile.

[@jboyce007]

Hellz yeah! Big Ng on the podcast!

[@marlhex6280]

Man this is one of the best guests that we can have in the field !!! 😂😂 that was awesome that you could get this generous man!!!! Such a wonderful human you to put him on the mic and him from providing such words

[@sampars7825]

I've become one of Andrew's fans, especially after starting Deep Learning specialization and finishing the first course. It has changed my life.

[@brunosemedo1998]

One of the best guests ever!

[@FloWoelki]

Two beasts in a conversation. Awesome stuff!

[@stanrock8015]

Become my fav KZbin channel. I’ve missed so many but I can binge forever. :-)

[@roccoincardona9836]

So inspiring! Thanks a lot for this and all the other interviews!

[@Jman2008xxl]

Well done, another tremendous interview! I am becoming more and more inspired to seek out and understand AI/machine learning and hopefully 1 day I can apply it to help solve the near impossible problem of Cybersecurity.

[@adversaryproductions5298]

I am new to learning AI too. I just started Andrew Ngs Deep learning course on coursera, its AWESOME and easy to understand! There is no time to waste, so much information, check out the free trial :) Good luck! I have big ideas about common sense and unassisted learning I hope to try out someday!

[@leizhong6369]

💚🤍love this conversation, the warmth and gentleness from the brilliant scientists, thanks

[@tunguyenlam]

Thank Lex for interesting conversation ! Thank Andrew, I'm one of your million students !

[@baselalyafi4022]

I have been waiting for this long ago. Thanks Andrew. Thanks Lex.

[@phil.4688]

To me, this was like watching one of the greatest "sensei" (teacher, master, guide) in the world with one of the most promising students of life in the same world (I mean that with all the benevolence and positivity possible, I love the "naive", honest, true world view that Lex shares with us). I could see the humility in Lex, responded in kind by Andrew - the true hallmark of greater human intelligence. That was a fantastic moment. I don't know if it gets bigger than this! ;-) Thank you so, so much Andrew and Lex for the awesomeness you both bring into this world. Here's to a future mankind powerful enough to level up in humility, and to our efforts on the way there.

[@jackvial5591]

Great interview! Andrew is a true legend. My only complaint is that I didn't hear him say "Concretely" once!

[@aldorodriguez7310]

I love Coursera even more now. I didn’t know he was a co-founder.

[@aashishsinghnagvanshi4155]

amazing season...i am learning a lot in this podcast ..thank you so much

[@hansmuster5291]

so much love and respect for this guy!

[@karlotake5369]

This was a very monotone discussion, but as it turns out, it was also the most inspirational discussion I've listened to in a long time. Seriously, this vid got me pumped. Also, yes, I'm an INTP.