Andrew Ng: Deep Learning, Education, and Real-World AI | Lex Fridman Podcast #73

[@lexfridman]

I really enjoyed this conversation with Andrew. Here's the outline: 0:00 - Introduction 2:23 - First few steps in AI 5:05 - Early days of online education 16:07 - Teaching on a whiteboard 17:46 - Pieter Abbeel and early research at Stanford 23:17 - Early days of deep learning 32:55 - Quick preview: deeplearning.ai, landing.ai, and AI fund 33:23 - deeplearning.ai: how to get started in deep learning 45:55 - Unsupervised learning 49:40 - deeplearning.ai (continued) 56:12 - Career in deep learning 58:56 - Should you get a PhD? 1:03:28 - AI fund - building startups 1:11:14 - Landing.ai - growing AI efforts in established companies 1:20:44 - Artificial general intelligence

[@dayanandak4667]

Thank you very much

[@zeitgeisttv5312]

The reason why hand writing is fundamentally different and more powerful because you are in the act of recalling and creating neural pathways. It's like drawing you are creating something from nothninness

[@avimohan6594]

About time! ( 😂)

[@aheinstein291]

I think you forgot: 1:22:02 How to throw shade at Elon Musk without mentioning his name. Jk, thanks for another great interview!

[@jf9229]

Absolutely loved this one!

I'm just a tradesman painting houses for a living but I stream these discussions in my headphones all day long while working. Even a luddite like me can gain so much from a guy like Andrew Ng - it's a quasi-spiritual process contemplating AI and how it relates to how I think and see the world. Even those not educated in this area ought to take an interest as its so intellectually enriching.

[@jeromedeleon1226]

you’re an inspiration! everyone has humble beginnings

[@josh_rdgrs]

I do construction and I do the same thing lol. Cool to see I'm not the only one.

[@refactoredcodes]

The work you do for money and your knowledge should not have to match. They are two different things. I am a software engineer and I want to learn to paint house. Because, that is a skill and activates different parts of brain. Education is everyones right. And, they should have access to it.

[@simokokko7550]

@@refactoredcodes Well said. Everyone should try to learn as much as possible. And like you said 'job's status level' should not define people. There are smart people everywhere.

[@kattmeating8315]

Bunch of good will huntings over here

[@Reve101]

I teared up when Andrew said “someone allow me the good fortune of helping them a little bit on their path to their dreams”. It restores my faith in humanity when I hear influential people like him with this much humility.

[@prof_shixo]

I have a PhD in AI and I can say that Andrew is THE BEST machine learning/AI educator I have ever seen on the field! The deeplearning specialization is just invaluable for any interested learner in DL.

[@pranav3658]

Hey, is it a Ph.D in standalone AI or is it Ph.D in CS with a concentration in AI? (PhD AI or PhD CS with AI concentration).

[@prof_shixo]

@@pranav3658 Hi, there is no such a PhD in AI as the specialization. Usually, it would be PhD in CS, Stats, or EE with a focus on AI and machine learning.

[@pranav3658]

Sherif Mosaad aah, thanks a lot for the reply! Also, I have an admit into the masters program in AI @ Boston University, AI is definitely what iam passionate about and a Ph.D is definitely a part of the bigger picture for me. Would you recommend I take it or rather settle for a more traditional MS in CS with focus on AI?

[@shravani9106]

@@prof_shixo hey I am 17 still in high school. I did some courses in machine learning and some data science courses.Topics like Neural Networks intimidate me. I wanna ask which major should I pick as my undergraduate degree. CS, electrical and electronics, or economics degree?

[@ivannav]

@@shravani9106 CS

[@shamsuddeen2004]

Whenever someone uses the word "It turns out", I remember Andrew Ng. I love Andrew Ng.

[@Max-lr6dk]

@@99dynasty i will buy it

[@bobblum2000]

@@99dynasty 1

[@re1konn]

@Potato Potato was gonna type the same thing haha

[@s.tahsin.r2288]

yes have heard those before every time a topic came up that Andrew feared might be too much for his students.

[@BingLi224]

recall his lectures

[@dra.adrianadomingosromer4968]

Im a physician from Brazil learning ai and this fine man helped me a lot thank you sir I salute you

[@super_stimulus]

I took Ng's class on Coursera years ago. It switched my career trajectory from academic to industry, and spurred my interest in making things. Awesome to see this interview!

[@stanrock8015]

Robert Lewis I’m late to the show and going thru it now but yes. Changing my career direction now

[@unreactive]

Hi, I take the same class. Can you recommend some next course or anything else?

[@super_stimulus]

@@unreactive I really enjoyed reading DataSmart by John Foreman. I also recommend the website "fast.ai" (I found out from Lex). Finally, there are good courses on specific techniques, programming languages, etc, on how to use ML on udemy.com. Udemy seems more practical, and has taught me how to actually implement some things and deploy them for use in the cloud.

[@unreactive]

Awesome, thanks!

[@Existence_Predicate]

How much is it?

[@joshryan4387]

I currently work as a computer vision engineer. I got hired having only a BS in Math and zero ML experience. My first assignment was to take Andrew's ML/DL classes on Coursera. Invaluable. Thank you!!

[@seetsamolapo5600]

Would you still recommend it for beginners today?

[@shairuno]

27:34 "If you want to make a breakthrough, you sometimes have to do something before it becomes popular". What a humble man :)

[@BenjaminKing-h6w]

Please Invite Andrew again on your podcast, he's definitely the righteous Science/Work-loving brilliant Instructor that I ever seen.

[@aishwaryamuchandi9005]

He's the best teacher I have met so far. He teaches all the concepts to its very core and many times even predicts his student's doubts and clears it(really felt as if i was into his class where all my doubts were getting cleared) . His teaching made me realize my passion for AI, ML which decided the trajectory of my career. He teaches such complex concepts in such a simplified way (that's the beauty of teacher).At one point of time I could literally visualize statistics making my foundations clear(especially gradient descent) . It will truly be my fortune and blessing to ever meet my mentor in person. Thanks Lex Fridman for this video where we all could know more about Prof Andrew Ng.

[@zeitgeisttv5312]

53:30 Andrew's Recommendation on how to learn more deeply with handwritten notes

[@Existence_Predicate]

Handwritten notes is better than typing but I thought that is not surprising. That being said, taking notes In itself is not that good for revision/recall. Active recall and spaced repetition are the best for that

[@aegystierone8505]

I have to agree with this, even while learning programming, writing things down actually helps a lot.

[@adognamedsally]

I found this basic technique very useful for studying kanji while learning Japanese. My theory at the time was that the extra effort I had to expend was forcing my brain to focus more on the content rather than going into autopilot mode. However, I also found that intervalled repetition was a big part in the learning process.

[@datasciyinfo5133]

Agreed. Active recall (trying to answer own questions with the solution covered) and spaced repetitions are best. But trying to summarize a point in your own words in almost as good. I think Andrew was pointing to that aspect.

[@TechOutAdam]

This man got a great voiceover career available at anytime.

[@Michael-Gill]

As a GenX'er I enjoyed this interview so much. It made me actually feel like I was experiencing the internet we were promised decades ago. A well thought out and intelligent conversation that, in the end, leaves the viewer in a state better than when they first pressed the play button. Well done.

[@Oblivic]

You’re making these vids almost as fast as I can watch them! Thanks so much my favorite podcast and my favorite thing on youtube.

[@MiroslawHorbal]

Thank you so much for making this available Lex. Andrew literally changed the direction of my life with his Stanford ML course and subsequent work with Coursera (which happened to introduce me to Geoffrey Hinton's deep learning course). His work ethic and drive to help the most people has helped reshape the face of education and I don't doubt it will leave a lasting positive impact on this world.

[@iirolenkkari9564]

I have taken several of Andrew Ng's courses. I have thoroughly enjoyed them and learned so much. He is a great teacher and a very likeable person.

[@pradnyachaughule7709]

Thanks Lex. The conversation is quite informative. Andrew NG is the one who introduced me to the world of Machine learning through Coursera few years back. I think it takes a special kind of expertise to make complex things sound simple. Andrew NG truly has done a great job at explaining basics of ML to all of us. He truly is the father of Machine/Deep learning.

[@zeitgeisttv5312]

Andrew Ng and Lex Fridaman voices are so soothing

[@GovindKumarMaliLucky]

Andrew Ng is my Guru.. This is first podcast I listed fully in a silent room

[@Niki007hound]

Fantastic interview. I took Andrew's ML course and am still deeply impressed by his pedagogical abilities. He is very observant and masters the art of passing on his knowledge. What an enrichtment these new distance learning WBT methods are for society! Perhaps the biggest improvement in this still new century for quality of life and fairness regarding access to knowledge and skills. Thank you from a humble admirer.

[@lifewithsoftware2.022]

Thanks!

[@nb8298]

Thanks for having Andrew on. He is above all else very authentic in his journey.

[@jentazim]

Thanks for being considerate in the way you do ads. Much appreciated.

[@mmughal]

This one I will listen full!

[@jahyegor]

Единственный подкаст, который я могу слушать постоянно. Лекс, спасибо за первоклассный контент! В сети вряд ли найдется другой такой же впечатляющий источник философского анализа темы искусственного интеллекта. Как говорится, instant classic )

[@nurgisaandasbek]

Thank you so much for making this available Lex.

[@nirajabcd]

Good to see so many of the listeners took up ML/DL courses from Andrew Ng. I am one of them and actually been doing professional work for more than a year. Without Andrew Ng and Coursera, I would have never gotten into ML.

[@engineer580]

Two of the people that encouraged me to do artificial intelligence are you. Thank you.

[@SudipBishwakarma]

Man I love your podcasts..Andrew Ng is such a great educator. His deep learning specialization on coursera is what got me into machine learning. His Stanford machine learning lecture playlist on KZbin is awesome as well.

[@thecanopenerpodcast8575]

Lex, thank you for educating the world for free, I am grateful beyond belief.

[@user-so7ix1pj7h]

Andrew Ng is really productive in AI area. His courses of deep learning is my first AI course. It is really helpful. Helping people working great in one area makes people feel happy. do something useful for other people. Thanks Andrew and Lex.

[@sakthiks777]

Andrew Ng is a great teacher, great person, great(to the power of n) to me and my friends. I request this great human being to build systems in healthcare and life sciences that would transform the lives of people around the world, particularly the poor-needy and under privileged.

[@TheAIEpiphany]

01:01:00 That's a huge piece of advice! And I couldn't agree more. People tend to get attracted to the logo - but the experience individuals have is so broad and ranges from poor to incredible even inside Google, Microsoft, Facebook and all of those famous tech companies.

[@johnfunk7568]

Lex, More love to you bud. Enrolled in Coursera and signed up for Andrew's course because of this!!! THANKS!

[@hg4875]

Andrew Ngs point about reframing the problem to solve it yourself was extremely insightful. I'm going to try this with my nephews when we make puzzles - I'll show him initially how some things can connect (not all) and have him "reframe it" to solve it himself! - super excited

[@nimmasoda]

#1:15:00 Ripple Effect #1:24:00 Wealth Inequality #1:26:00 Mistake of Late Realization (Do not regret) What a golden interview it is... So much inspired by his words. We need Part-2 of Andrew ng, after his another ground breaking work. Such a great human-being in Tech space __/\__

[@eidios6871]

I've been waiting for this!!! Thanks bro!

[@hetheas7906]

Andrew Ng is, without a doubt, the best lecturer out there!

[@iamhandk]

This is so awesome! Thanks for having Andrew on.

[@manhalrahman5785]

Listening to Andrew Ng is so nostalgic lol I remember how much I enjoyed my first step into AI with his ML course

[@kyrgyzsanjar]

Andrew is one of those people whos impact on the world is impossible to estimate. He's a living legend. Born to be an educator.

[@ss00mm11]

I came from no formal education on computer science or AI, took Ng's machine learning MOOC, and fast forward a few years and now I'm in my 2nd year of my CS PhD with a focus on AI.

[@seetsamolapo5600]

Wait, so you got into CS PhD without doing the CS undergrad?

[@ss00mm11]

I had an undergraduate degree in physics and master's in mechanical engineering@@seetsamolapo5600

[@romandorosh8473]

This man has pulled some strings of my soul. And it's really motivate me for dive in this field. Thank you, Lex

[@arunramji]

Andrew NG has lot of fans in INDIA 😊

[@submagr]

Thanks, Lex for this amazing podcast. Thanks Prof. Ng for thoughtful advices. What I liked best - Try to study 2 Research Papers every week, make a habit of something. Think about who would be your peers before joining a team. Thanks.

[@nirajabcd]

Andrew Ng was the reason I started doing AI/ML. Big fan of him.

[@HeisenbergHK]

The best explnation of gradient decent I've ever heard was from this man, Andrew Ng.

[@vijayabhaskar-j]

Both are wearing their iconic dresses! XD

[@BasharAlkhalili]

Those are their super hero suits

[@matthewchunk3689]

@@BasharAlkhalili brilliant people seem creatures of habbit. what to wear is not just a distraction, it's irrelevent to them (i'm thinking of einstein in those effeminate sandals)

[@e-readers]

I really enjoyed this interview done by you and Andrew.

[@joyeo2498]

Hands down to Andrew. Great mind with such a down to earth personality. Just love composed and calm vibe that he gives out when he talks as well.

[@bluestacks661]

He explains very eloquently actually! Thanks for the interview, Lex!

[@hamidabatemam2947]

thank yuo lex and andrew so much🍎

[@imraulemmaka511]

I was long waiting for you to bring him!!

[@carlosvillarreal7989]

Andrew's videos on KZbin are goated. 🐐

[@manuelillanes1635]

I'm a psychologist trying to jump to AI, this was my first professor even though he doesn't know about me I'm very grateful for his existence. Thanks Lex.

[@caijason9486]

Great job. I have been totally inspired by Andrew Ng two years ago.

[@aaditya_ai]

Finally ! Andrew Ng.

[@vegas1854]

It's an amazing time to be alive. I'm fascinated by Auudia's new Vodacast. Perfect podcast compliment.

[@sigangsabaglari3606]

Thank you Andrew Ng, you are the best. I'm learning so much from you.

[@l_a_h797]

Thank you for pronouncing "Ng" at the beginning of the video! His name is everywhere, but it's not easy to find out the pronunciation. Also great questions, and inspiring, insightful answers from Andrew.

[@krasimirzlatev4843]

Nice listening/watching to both of you. Thank you.

[@ivanpineda258]

This is one of the most impactful podcasts I've heard! Thanks so much, Lex & Andrew!

[@petersenglish]

Ng's Coursera machine learning course is among the hardest but most interesting courses I've ever taken. I got all the way to Week 5!

[@seetsamolapo5600]

How many weeks is it?

[@neuroling]

This is a very inspirational interview. Thanks for it, Lex!

[@henrycowsert3999]

You've come so far lex!

[@VysakhRemesh]

Thank you Andrew Ng and Lex Fridman

[@marlhex6280]

Man this is one of the best guests that we can have in the field !!! 😂😂 that was awesome that you could get this generous man!!!! Such a wonderful human you to put him on the mic and him from providing such words

[@ramon1f]

Great, enjoying my dinner at the moment. time to feed my brain some information also! Let's go.

[@8adeight]

Ng's accent is completely mesmerizing. I feel like I'm learning just listening.

[@JousefM]

I like all of your Podcasts Lex, but this one will probably be the first one that I watch from beginning to the end! AndrewNg 4 president! :D

[@thienphanphuoc4824]

Prof. Andrew Ng is a very respected man with his smile.

[@dalchemistt7]

Woo-hoo....It's Andrew Ng. My 3 most admired virtual teachers are Prof. Strang, Tsitsiklis and Ng. Two have been here and only Prof. Tsitsiklis is remaining now. Thanks Lex.

[@aashishsinghnagvanshi4155]

amazing season...i am learning a lot in this podcast ..thank you so much

[@avinandanbanerjee9568]

no words can describe how much i love andrew

[@sampars7825]

I've become one of Andrew's fans, especially after starting Deep Learning specialization and finishing the first course. It has changed my life.

[@samnguyen-nhp]

Andrew Ng, my great teacher.❤

[@leizhong6369]

💚🤍love this conversation, the warmth and gentleness from the brilliant scientists, thanks

[@bakhtiyor_sulaymonov]

Thanks for the podcast

[@Ramlingamr]

Fantastic! What I like about your casts is the choice of people to talk to and meaningful line of discussion. They elevate our understanding a little bit, looking forward to every episode!!

[@mqasemniksefat4202]

I love the guy! He influenced my knowledge and path, as well as many of you, for the better!

[@FloWoelki]

Two beasts in a conversation. Awesome stuff!

[@hillstudios1]

Thank you Andrew and Coursera

[@anandbalivada7461]

This week has been awesome! First Scott Aaronson and now Andrew Ng :). Lex, it'd be really cool if you could get someone working on the theoretical aspects of Machine Learning, like Sanjeev Arora, Ankur Moitra or Costis Daskalakis... It'd be super interesting to see the conversation between experts on two different sides of the same coin; applied and theoretical.

[@endgamefond]

Andrew Ng is a great teacher. I took his courses in deep learning and it's better than cs50 from harvard.

[@tunguyenlam]

Thank Lex for interesting conversation ! Thank Andrew, I'm one of your million students !

[@PrabhatKumar-fn4vy]

Thanx for bringing Andrew

[@mustaqimkhan6885]

Thank you Lex Fridman for this great podcast!

[@thequantartist]

Loved this video, I found it really interesting to hear Andrew Ng draw the analogy of litteracy to data science or coding skills.

[@ryanwickman855]

Amazing to see two great minds talk! Especially Andrew Ng who introduced me to the field of machine learning!

[@hansmuster5291]

so much love and respect for this guy!

[@manbunmath]

I love the part where they talk about handwritten notes over typed notes. The fact that you have to "encode" the information in order to write it down in fewer words [rather than be able to transcribe verbatim when typing] is key. When we encode the data for our notes, we are learning a set of nonlinear transformations which connect our encoded notes and the original, larger resolution, message. In performing such a task, we learn features about the message, thus gaining what we call "a deeper understanding." The brain is a wonderful machine.

[@baselalyafi4022]

I have been waiting for this long ago. Thanks Andrew. Thanks Lex.

[@dodogo777]

andrew ng, best AI/ML educator ever !

[@AxelC2020]

ok, after watching Lex for for a while I finally enrolled into coursera AI course.

[@kevthedestroyer1044]

yeah deeplearning.ai has two great courses

[@brunosemedo1998]

One of the best guests ever!

[@MrAscetic23]

Fantastic, just in time for my 2hr drive

[@adesantoasman8585]

thank you for your hard work mr. Ng. Me ,one, who very much inspired by your online course in Machine Learning

[@rayryeng]

I'm used to watching his videos at 1.5x... so hearing his voice at normal speed tripped me out lol. Joking aside, what a great interview with a true pioneer and legend. Thanks so much Lex!

[@ashsilver8653]

So exciting to see this talk. Two years ago, I started learning ML, the first series of courses about ML I watched were made by NG. He is my first ML/DL influence. He is such a nice educator.