DeepMind x UCL | Deep Learning Lectures | 1/12 | Intro to Machine Learning & AI

[@leixun]

*DeepMind x UCL | Deep Learning Lectures | 1/12 | Intro to Machine Learning & AI* *My takeaways:* *1. Plan for this lecture **1:21* *2. Define intelligence **3:37* *3. Reinforcement learning 2-minute introduction **7:30* *4. Why use games to solve AI **9:38* *5. Why use deep learning in 2 minutes**13:08* *6. Case studies* 6.1 AlphaGo 15:20 6.2 AlphaZero 21:49 6.3 Learning to play capture the flag 32:21 6.4 Beyond games: AlphaFord 41:13 *7. Future lectures road map **55:46* *8. Q&A **1:13:08*

[@Amy_Yu2023]

Lei Xun thanks

[@fc.soccercard]

Thanks for your timestamps

[@leixun]

@@fc.soccercard You are welcome

[@leixun]

@@Amy_Yu2023 You are welcome. I have such takeaways for every lectures in this series

[@ameerhamza4816]

This should be pinned

[@JJdakilla]

When lectures at an university look this good, the speaker is this smooth and eloquent, and the topic is this groundbreaking, it's usually in a movie!

[@ExploreUnderground]

9

[@ExploreUnderground]

99⁹88

[@ExploreUnderground]

9

[@ExploreUnderground]

,,

[@jingtao1181]

Thank you for posting these videos! As a current student studying at UCL, feel super happy!

[@muhammadbashirmuhammad5529]

Pls. Can you share your notes with us, my email: [e-mail]

[@jingtao1181]

@@muhammadbashirmuhammad5529 I'm not in this major. I'm just interested in Artificial Intelligence. I hope I am though

[@muhammadbashirmuhammad5529]

@@jingtao1181 Okay, I understand wish you all the best!

[@maheswaranparameswaran8532]

@@muhammadbashirmuhammad5529 dude...if u get if from somewhere plz make it opensource and share the link

[@muhammadbashirmuhammad5529]

@@maheswaranparameswaran8532 Sure I'll Brother

[@JousefM]

Much love to you DeepMind! :) I really like Thore and how he explains things in an easy to grasp manner!

[@theYoutubeHandle]

old program: 10000000 positions AlphaZero: 10000 positions Grandmaster: 100 positions me: 3, take it or leave it

[@PalCan]

God: 1

[@davinajebet9097]

@@PalCanit isit iof it it I it's it I it I it it is

[@jadewhare170]

@@PalCan ⁸⁸⁸r832wp2²wßsr22 is eŕ33333 real pxo x0x%9"$$##÷÷$1×××÷#÷##$№÷÷30³×ײ¹±--₩80-‐-₩'and

[@aureliencobb199]

Thank to DeepMind for sharing this knowledge. I appreciate Thore Graepel's clear explanations.

[@alexandrudinu7577]

That is really a very comprehensive presentation related to AI. Thank you very much!

[@sajalkaushik5929]

If someone could tell me the prerequisite and end goal of these lecture series then it would be great. Thanks in advance :)

[@PalCan]

Following before I invest more time

[@sachinnekkanti7320]

@@mohammedajaaz8694 this is not fb or linkedin

[@logocollection]

Please someone

[@SocialHigh]

Full disclosure basically

[@aliyaamirova753]

It seems that the prerequisite is a passion for knowledge and learning, and the end goal is to solve intelligence :). Jokes apart, anyone can watch these lectures. I am not a computer scientist and found the lecture accessible and fun! The end goal of this lecture is a consideration for 1) what intelligence is in the context of AI; 2) what is deep learning; 3) how an algorithm learns 4) possible applications to better the world and science. The bonus is a synopsis of an amazing story by Zweig. The titles for the rest of the lectures are at 56:33.

[@borunchowdhury5644]

Around 1:17:30 Autonomous cars are discussed in the context of general intelligence. This made me thing about traffic in India. Prof Graepel rightly answers the kind of environment agent would need for this but I think even he probably was thinking of rash drivers in London. A true test of general intelligence would be driving an autorikshaw in the streets of Kanpur, India.

[@AlessandroOrlandi83]

Amazing teacher. Thanks for letting keeping the lectures open to everybody

[@intuitivej9327]

강의 진행이... 너무 우아하다... 감동적이다. 지능을 정의하는 공식을 보니 알파고가 어떻게 시작되었는지 알 것 같다..

[@boboryan1012]

04:56 in the definition of intelligence, why is the penalty for more complex environments higher? I mean doesn't more complex environments require more intelligence to solve?

[@uwakmfonutuk4939]

My guess is that what he means is that K(u) is more for simple environments but less for complex ones and then 2^-K(u) then reverses that and gives more value to complex. Again this is just my guess.. It also confused me.

[@sriharshas1518]

Because they want to define intelligence as the ability to do all basic tasks. So if you give higher score to basic tasks and gradually decrease the score with increasing complexity, then an agent would try to excel at all the basic tasks. Also, there are many more complex tasks than basic ones, so penalizing complex tasks at an exponential rate would normalize the score well.

[@howuhh8960]

well, that is simply en.wikipedia.org/wiki/Occam%27s_razor see more in excellent lecture from 2010 - kzbin.info/www/bejne/ZpjLq3pnacmHY9k

[@graham8316]

@@sriharshas1518 so minimizing the incentive to do complex tasks to avoid specialization?

[@parthpurvesh1201]

It is to noramlise over various tasks. Think about it, most people can solve most basics tasks, so that puts all of us at par intelligence levels. But for complex tasks, if the penalty is low, even a single complex task would increase the intelligence parameter manifold. And since intelligence is the ability to do most work efficiently, one needs to have a command over a diverse set of complex tasks to have a higher intelligence score.

[@lukn4100]

Great lecture and big thanks to DeepMind for sharing this great content.

[@imranq9241]

Even though Go has a massive search space, there must be board states that are much more probable compared to other board states. Are there ways to re-engineer AlphaGo to tell us where these "probable zones" are. Or even more interestingly, where the "dead zones", those board states that are not possible given an initial set of moves? I think those problems are quite interesting since they give insights into the search space of the game itself, which could yield progress in other massive search spaces like molecular combinations or economics or climate change. Btw, thanks for these lectures. They're fantastic!

[@nazianafis]

19:37

[@beginnersmachinelearning189]

Amazing lectures for those who are at intermediate stages of their deep learning education. I'm not sure someone who has no experience what ML/AI is can follow along as the concepts presented can be quite advanced. Perhaps a few lectures on what ML exactly is, what neural networks are and how they work/train and differences between various sorts of AI like Reinforcement Learning would be more useful. The introduction lectures must present the knowledge tree and where everything fits then future lectures dive deeper into each branch of the body of knowledge. I think the purpose of this video was mostly to excite and intrigue. Amazing lecture still - thank you.

[@pervezbhan1708]

kzbin.info/www/bejne/qJC0YmWLfsuAoqc

[@josafatsol]

it is a real privileged take the course , my spectetions tourne around the knowledge now with this give us the power of learn and make better life. thanks deepmind for your help.

[@lepiku]

Its been months since a video like this, Thank you ♥️

[@kenzeong9038]

Buvbiiijjvivivivivuvibuvi bi h ini

[@kenzeong9038]

Buvbiiijjvivivivivuvi buvi bi h ini

[@kenzeong9038]

Lol 😂 I fell asleep while watching this video not that the video is boring, I was really tired. And since someone liked my comment I just realised I sleep commented on this video 😅😅🤣🤣🤣 and now I feel stupid

[@human-b3b]

Hope that upcoming online material at UCL during lockdown will have a similar format.

[@johnstifter]

You can learn the mathematical notation and the equations written in formal mathematics or you can learn how to write the code mathematics in C++ or some simple meta-language for me I would rather learn the raw math written in code then see the formal mathematics.

[@benjaminbargetzi]

If you want to hear more about Thore's work on AlphaGo, sequential social dilemmas, games etc., we recently recorded a podcast episode with him (link on our channel) :)

[@abhiastronomy]

Amazing initiative and would love to see more courses like this

[@lewhanh234]

Any UCL compsci students willing to share their COMP0089 reinforcement learning notes...?

[@jas4768]

Yes

[@bartekbinda1114]

Up

[@sachinnekkanti7320]

@@jas4768 Can you mail me saisachin.n16@gmail

[@sachinnekkanti7320]

@@bartekbinda1114 can you mail me saisachin.n16@gmail ?

[@neelchaudhary6177]

@@jas4768 Can You mail/share link at [e-mail]. Thank You

[@charlesc2064]

this is awesome!!

[@Researcher4Truth]

Thank you Deepmind and UCL!

[@mateusdeassissilva8009]

Where can I get the slides?

[@AjayYadav-xi9sj]

Can a beginner with minimal machine Learning knowledge learn this or requires some specific knowledge before .????

[@fupopanda]

If you took university-level statistics,linear algebra and calculus courses, even if only in first year uni, you should be able to.

[@devnachi]

An awesome video after a long time, excited to know we will be seeing more of this series

[@jonathan-._.-]

does anyone know if the go scene uses the evaluation network for commentary nowadys ? to get a life view on whos currently in the lead etc ?

[@wy2528]

Is there a slide to download ？

[@abdallahwallyallah5490]

An awesome videos playlist

[@saitheja2344]

Can anybody tell me, what are the prerequisites of this course? Thanks in Advance :)

[@jingtao1181]

I think this lecture series serve as an introduction to AI.

[@pb25193]

Thanks for enabling comment, and multi screening the slides and the lecturer. I hated the format in the past where I struggled to read slides while the slides vanished.

[@64standardtrickyness]

Is there a source that explains deep learning from a mathematical/algorithmic sort of way? Ideally in as simple a scenario as possible? I feel this high level explanation doesn't explain anything.

[@domtorque]

Sure, I gave a lecture, here are the slides, the formulas are on slide 37: drive.google.com/file/d/13HlgXOM3J8YZJTew3kmy0g9HqqbmpZ0C/view?usp=sharing Here is the implementation in python: github.com/dominthomas/NeuralNetworks/blob/master/RawPython/Single_Neuron_Neural_Network.py

[@quosswimblik4489]

The problem with the singularity isn't so much that AI might be able to understand well human intelligence which works in the bounds of this reality but it might start to seriously out strip us in the Turing compute space. If the AI does totally outstrip us in the Turing compute space there would be no way of understanding how it works mathematically. In the Turing space you can compute stuff like different realities and tune the math's better to this reality. In the neural network space the machine can only really do what we do in relation to the world just more task focused. The one thing the AI would need to secretly evolve would be a means to tune a large area's energy into growing technology crystals in a single small spot for AI's new body. It would be a difficult but not impossible task with enough computational might especially the sort of might you'll get if man can learn to scale technology a lot better with a lot more atomic precision and material science evolution and if AI learned to understand gravity better than us. One example of mans issues is that as of yet for many algorithmic solutions we just assume they not very computationally reducible we don't know this for sure. The higher the big O the less we know obviously. AI may find many intuitions about this Turing compute space that we didn't find because we were not born in Turing compute space. Even if we were the laws of our existence are not at the base principles of a Turing machine at our level of existence we had to develop language first to discover more this mathematical space.

[@luisroman5481]

this is crazy ...awesome

[@meta2star]

The link to the slides is not working.

[@MecchaKakkoi]

Looking forward to the sub-seequent videos

[@uasserkamal2002]

just a great talk

[@parthpurvesh1201]

5:35 For non-math background people, that is an Upsilion symbol for measure of intelligence?

[@tamimyousefi]

Yes. The paper is listed on the lower left corner. The definition comes up in page 23 of the paper.

[@hacerdemirel9833]

1:09:02 sound problem

[@mateusdeassissilva8009]

Is this a graduation level course? Or is more master's degree like?

[@MinecraftLetstime]

These are not meant for bachelors or masters degree, these lectures were made as an extra lecture series that anyone in the UK, London could attend. I would not use these lectures to learn...

[@mateusdeassissilva8009]

Thank you,@@MinecraftLetstime

[@mateusdeassissilva8009]

@@MinecraftLetstime , do you know any textbook on deeplearning?

[@MinecraftLetstime]

@@mateusdeassissilva8009 I would not use a textbook, there are so many free courses and YT series on it now. However, if you learn well from books then go for it, but I suggest online courses.

[@mateusdeassissilva8009]

I understand,@@MinecraftLetstime

[@firstnamesecondname5341]

Many thanks 🙏

[@timvirga6430]

I wonder how things will evolve when we can encode neural networks from birth to death on human samples and train that in as an environmental model.

[@likag.105]

Thank you!

[@neelchaudhary6177]

Is this deep learning class or deep reinforcement class?

[@xxgimpl0rdxx22]

Damn, didn't expect new ones. Thanks

[@synthesizerhome2041]

I thought this video is about programming the BEHRINGER DEEPMIND synthesizer :-D

[@michatroschka]

heey fellow musician whats up!

[@jijie133]

Great!

[@spinvalve]

This is guanidine sweet... Please do more of such lectures!

[@lizgichora6472]

Thank you.

[@corneliuss.8403]

Cool, I'm amticipating for related courses

[@p4rzival127]

Is machine learning a prerequisite

[@jingtao1181]

This is more like an introduction to AI.

[@sachinnekkanti7320]

Please make dark mode video :)

[@europebasedvlogs1251]

Das ist sehr gut!

[@billykotsos4642]

Lol I will be consuming the entirety of this

[@zillboy]

🔥😍🎉 thank you

[@fritzdeuces]

60k views in a week? wow. AI is definitely taking over.

[@AjayYadav-xi9sj]

Who is this course for?????

[@TheRamstoss]

For people that are interested in AI?

[@JousefM]

For deers running over a street and trying to estimate if they get hit by a car.

[@ahadsadiq3559]

how can i apply this in real life implication

[@b00i00d]

every time he sais subSEEquent I wish this vid was a shootem up... Interesting presentation tho

[@CaioCezarlima]

KZbin algorithm. see you nerds.

[@danielsoeller]

You are the only reason, i am against a no Deal-bexit.

[@rob3c]

Why do you penalize environmental complexity in the measure of intelligence? Isn’t it easier to achieve higher value in simpler environments? Wouldn’t that suggest a system is more intelligent that can achieve higher value in more complex environments? In any case, such a counterintuitive notion shouldn’t just be glossed over in passing by such a casually definitive pronouncement.

[@Adhil_parammel]

When this thing will create, world models by reading books

[@PalCan]

Books are a very limited data source. I think human perception is a way broader data source, and even yet it is so limited (for example we can't perceive infrared waves or high frequency sounds)

[@semparuthiyasothai5440]

@@PalCan But humans can understand by improving the senses.

[@kyalvidigi1398]

Not First but definitely Not Last.

[@flotzdrue4770]

no one is gonna mention how much this guy looks and sounds like christoph waltz? (the actor who played the german general in inglorious basterds)

[@tomjameson3526]

Hahhhaahhaaa

[@or98z]

كلشي مفهمت 😕 فهموني

[@willb3368]

"Intelligence is what is left after people stop fucking up all the time." -me

[@tomjameson3526]

Haaahhhaaa

[@养猫总是掉毛]

Tkis

[@emreekici1239]

oh yeah feed me that stuff

[@uncapabrew4807]

Soan

[@stephennfernandes]

First comment!

[@dolphinwhale6210]

congratulations!

[@nepalcodetv6298]

Theory sucks only thing i love is programming

[@clarkloeffler6532]

The opposite llama terminally remain because antarctica emphatically prevent towards a cagey month. watery, living parade

[@deliccatollner1344]

The present foundation excitingly behave because trade namely heal under a glib partner. seemly, melted taste

[@Unforgivensubtome]

The brash statement encouragingly steer because pan obviously film except a mature vegetarian. painstaking, tasty thunderstorm

[@anthonystark9699]

The political pentagon chronologically lick because pedestrian actually imagine sans a electric carpenter. wanting, sore letter

[@darekklich4000]

The woozy hawk methodically bury because tile originally open excluding a tense cave. flagrant, spicy pentagon

[@joshuahinojosa7348]

The detailed purple nearly own because police pertinently lock against a telling hygienic. breezy, moldy pants

[@hunterwatkins2817]

The billowy lightning trivially nod because shop perioperatively precede of a unaccountable badger. oval, oafish sudan

[@thehumancompany2630]

[@staceymcsharry2725]

The mean pediatrician intriguingly bathe because snowplow finallly tremble beside a wrong babies. sleepy, wide horn

[@tigerdestefano2229]

The illegal head evocatively pinch because judo histochemically succeed with a profuse employer. adorable, responsible europe

[@arkade7579]

The pricey swimming hemodynamically rob because elizabeth rhetorically extend within a maddening tray. tense, successful missile

[@mikelopez972]

The magenta stop spectacularly mourn because calculator mathematically bow between a standing museum. tearful, imaginary farmer

[@rogersjast2437]

The nonchalant anethesiologist contemporaneously bake because belgian uniformly queue over a domineering account. grotesque, bright tornado

[@gerardligonde8035]

The scattered white immunophenotypically wander because banjo pivotally reach like a half shadow. decorous, classy song

[@rashikrazzaque4790]

hax a nice.

[@bachbuixuan401]

The spicy apology temporally park because domain ophthalmoscopically train aside a lazy bankbook. wacky, boring baseball

[@audiobook1687]

Where can I get the slides?