Deep Dream (Google) - Computerphile

Surreal images created by Google's Deep Dream code flooded the internet in 2015 but how does deep dream do it? Image analyst Dr Mike Pound.
Inside a Neural Network: • Inside a Neural Networ...
Cookie Stealing: • Cookie Stealing - Comp...
FPS & Digital Video: • FPS & Digital Video - ...
Password Cracking: • Password Cracking - Co...
Gamer's Paradise: • Gamer's Paradise - Com...
/ computerphile
/ computer_phile
This video was filmed and edited by Sean Riley.
Computer Science at the University of Nottingham: bit.ly/nottscom...
Computerphile is a sister project to Brady Haran's Numberphile. More at www.bradyharan.com

[@Thesupremeone34]

"I want more. I want more ears, I want more paws, I want more bits of cat." have you tried anime?

[@ongeri]

😂😂 this had me laughing alone like a madman

[@justamanofculture12]

"Ah, I see you are a man of culture as well 😌."

[@justinhamann8690]

😂😂😂😂😂😂😂

[@Finkelfunk]

You know you are a programmer when you exactly have 6 books standing on your shelf because you learned the rest from online-tutorials.

[@yexuanjcortes1098]

LOL

[@yexuanjcortes1098]

and what about the rubik's cube! is a kit part as well x'D

[@serjoka77]

Or by reverse engineering

[@mu11668B]

LOL you got me. I learned Java entirely by online tuts. But it would've be a pain in the a$$ if I didn't have the interest tbh.

[@Theineluctable_SOME_CANT]

No...

[@crazyluigi6664]

Honestly, some of these images look like they belong in a museum of some kind.

[@leonm8906]

maybe in a museum that focuses on technology? Or one that might even solely focus on computers or even just the internet.

[@MD-pg1fh]

You belong in a museum!

[@procerator]

That`s most epic Hearthstone mentioning I`ve ever seen. :)

[@SpriteGuard]

Perhaps in Strangethink's Secret Habitat museums?

[@stoppi89]

+Moritz Durtschi Give this guy a medal.

[@guydht1]

Why haven't I heard about such an interesting thing up until now?????

[@Kram1032]

no seriously, how DID you miss this? This was _everywhere_ not all too long ago.

[@KevinVandyTech]

It was all over the news about a year ago

[@somesquirrel]

There is a subbreddit for this / r/deepdream

[@4c6f]

you must be deaf

[@DuppyTree]

im just hearing about it now lol

[@darronb248]

How do we get into a class with this fella. He makes me want to learn computing skills. Clear, precise, funny, knowledgeable, makes learning fun...

[@cobani4956]

This guy is amazing how does this have so little views?

[@crazyluigi6664]

I think one part is that, at this time, there's not really many programmers around at this time. However, another more reasonable part is that this is actually their most recent video, which actually doesn't record much views around this point in time.

[@cobani4956]

I am subscribed for interesting things, and also becasue i want to learn more proggraming though i only know C. So im really impressed some times on this channel.

[@ITR]

Because it's not long since it was uploaded...?

[@lumpa87]

Because you made your comment after the video been live for 15 minutes.

[@DavidVaughan00]

By the time A.I. makes programmers obsolete, they'll have already made most other jobs obsolete as well lol

[@2Cerealbox]

I think this is the most accessible explanation of Deep Dream I've heard. Although I do disagree that you can't explain backpropagation and gradient descent in an intuitive way.

[@daggawagga]

yeah, Coursera's Machine Learning course has relatively short videos showing it and I thought they were quite reasonable

[@zinqtable1092]

I believe the word intuitive is rather personal though. Some are intuitively good at drawing, others are better at math, some at writing, and few are good at it all "generally". We need a new word (or already established word) that measures the general intuitiveness of some knowledge. How easily it can be grasped.

[@brendanbennett6770]

I think we could use approachabilty

[@wutchutalkinboutwill]

Innate comes close

[@OttoFazzl]

The most accessible explanation is by Jeremy Howard and his free online course at course.fast.ai

[@skybertronic]

And look where we are now.

[@Jone952]

I wonder if this has anything to do with why people see faces in inanimate objects? Are our brains maximizing neurons for facial recognition?

[@scorched1598]

Also instinct, so you can recognize faces from birth.

[@Dwarg91]

That is actually exactly what our brains are trying to do.

[@SweetHyunho]

Yes, that's why you look at the shirt in your room and think it's a ghost. Also if you're anticipating a phone call, anything that resembles your phone ringing will be mistaken as phone ringtone.

[@josenildoferreiraassuncao8963]

I see faces in cars.

[@Migger_29]

All around me are familiar faces...

[@spicyfrank1]

The hills do indeed have eyes

[@Shadow77999]

Lol

[@justamanofculture12]

They have a soul

[@oscarsmith3942]

Am I the only one who really wants computerphile2 with math and stuff?

[@Un4GivNX]

So look at the "Numberphile" channel?

[@oscarsmith3942]

+Un4GivNX I know of it, my point is that somewhere with all the gritty calculus would be great

[@Laloloop]

I would like that channel also, with all the math involved

[@Lergurker]

You are not alone

[@robbowman8770]

I want this

[@d_9696]

11:28 "It's more of a cat than the landscape was."

[@seanm7445]

‘I’m all ears.'

[@predvcecerom]

"Are you sure, that's how it works?" - Google Engineer

[@black_platypus]

"Are you sure about that comma?" - Literate people ;P

[@predvcecerom]

Well comma is an instruction on how to read a sentence. It is a bit different in formal documents than it is on internet. So relax and enjoy the freedom.

[@C4rb0neum]

Underrated comment.

[@szym1]

Absolutely awesome video. This guy is not only smart but also teaches in a very entertaining way. More of him please!

[@gregg4]

This guy is certainly forward-thinking when it comes to shelf space for books.

[@SicTr4nsit]

Thank you for this great explanation. I love programming and have started taking interest in neural nets! This really gives me a lot to think about. Perhaps giving lower-lever nodes weight for what the hit is NOT can help ascertain the weight of a node from a newer generations' determined context via back propagation. I expect a door across the room from me because I am aware that I am in a room. If all of the sudden I were to see a giant walrus instead of my door; it would be obvious my context was wrong. I'm either dreaming or crazy. Even psychologically speaking, we see more of what we think and see. If I'm constantly bombarded with cat images, I would most likely start seeing cat faces everywhere. If I am in my living room; I know what should typically not exist in a room from being in various rooms over the course of my lifetime. Anything unexpected, and my brain just fills in the blanks because things out of context get forced into a context that fits. Deep Dream is only going off the life it's lived, and is already exhibiting all these emergent properties I'm not hip to all the terminology; but I'm definitely fascinated.

[@RoberttheWise]

Digital cloud gazing basically. "Whoa, dude! That cloud looks like a cat. And that too. And that one looks like a bunch of cats." "You are obsessed with cats, Jim."

[@wism881]

what a pleasant voice to listen to

[@DanielJohnNicholson]

You can't change C, it's the speed of light.

[@PeterUllmer-ALDP]

i love interdiscipline jokes.

[@mgoksu33]

I guess this is one of the coolest videos in this channel

[@katjejoek]

I saw this movie earlier today and later saw Jason Bourne in the cinema. JB also has a computer related Deep Dream in it. I couldn't help thinking about this movie, of course. Anyhow, Mike and Brady, thanks again for a great computerphile episode.

[@foxorian]

I get the feeling Mike has accidentally dashed a line across his monitor at least once while pointing to it with a marker like that. - 1:13

[@michaelbader8307]

What an excellent explanation of such a tricky topic

[@walterclementsjr.5947]

1:11 his face brought so much joy and enthusiasm. i love this guy.

[@2Cerealbox]

I mean, cats are basically just a bag of fur with ears and eyes.

[@BigDaddyWes]

Salvidor Digitali

[@anonymouscode1616]

The camera man of ComputerPhile is going to become expert in all fields of computer

[@Computerphile]

I wish I could retain half of it! -Sean

[@anonymouscode1616]

@@Computerphile so your name is Sean . I didn't expect you reply. Thanks you

[@LegendofMicah]

Thank you for this! I'm a pro video editor, but I don't know the first thing about programming. I recently learned about altering video images using a neural network, and this is the first resource I've found that can break it down in a way I start to understand. Thanks!

[@RealEsther]

those deep dream pictures always give me a shiver...

[@preferredimage]

Most pointless shelves ever. :)

[@foxorian]

Makes me feel like I'm back in my college dorm lol

[@alalize]

His main shelf is on his desk. ;)

[@Nostalgianerd]

That rubik's cube isn't going to float by itself.

[@ncuxap12444]

true story

[@Roxor128]

Shows how much computer science folk rely on online documentation. :-)

[@wmramsey26]

mike pound is the best!

[@googlr214]

I really love this series, Dr Pound

[@hyderhydra3269]

@6:55 you've never seen a rabbit fox bird before?

[@Wastelander1972]

I do essentially the same thing when I use the bathroom and look for hidden pictures in the linoleum. Mind = Blown.

[@mp9305]

After my exams I'm making it my mission to watch every single Computerphile video ever. Also, I wonder if these guys are mini celebrities on Notts campus in the UK. I know that's how I'd see them lol

[@spliter88]

One thing that wasn't explained (or I missed it) was: how exactly are the images changed to have the result we want? What operations are applied to the image to give the result that decreases the error?

[@black_platypus]

Well, if you look at the video about convolutional neuron networks, you'll see it's all some small kernels with basic functions and abstract operations working with weights of previous layers. The thing is that we don't know specifically what they're doing at that point, because it's been so convoluted and abstracted that it's impossible to ascribe human readable meaning to it. You just look at the results, and if they're better after some change, you keep changing in that direction. Inverting the process uses the same process: We more or less know what we want (through training the network), so we can use the skews in that direction

[@teekanne15]

That empty shelf somehow bothers me... those books need some company

[@2Cerealbox]

He first started in this series at that office with absolutely nothing there. Each episode he seems to get more and more.

[@teekanne15]

Ryan N I know, thats why its so sad ... its been like this for months....

[@Cha0sNicr0]

So if I got this right its something like this: "This leaf looks like a cat-feature, let's put more things with cat-features in the picture." Right?

[@rusduderus]

"I want more bits of cat!" sounded kinda creepy :x

[@GordonjSmith1]

What an excellent demonstration of ML...

[@floriank4415]

What I think would be interesting to see is a network that was let's say, specifically trained to identify cats and not give it any input but tell it to maximize on the highest level the feature "cat" itself so find out what in the eye of the network the optimal cat is.

[@razhemo4191]

how will you not give it any input? the whole point of deep learning and neural network is that there has to be some sort of training data. the machine's perspective about this ideal cat is just some output of the images you gave it- you give it different pictures, it forms different opinions on how a cat really looks like. it doesn't conjure them out of thin air.

[@floriank4415]

I am aware of that, I meant to not input anything after it has been trained and just reverse the neural network, so instead of starting with a picture to identify or hallucinate into an existing image start with the result 'cat' reverse the network and look at what it comes up with.

[@EllipticGeometry]

It sounds like it works like Newton's method. Newton's method will only find a local minimum, which might not even be a (real) root. If the derivative at the current point is zero it doesn't do anything. There are other kinds of traps depending on the function. If you fed Deep Dream a solid color, it would probably behave similarly. It needs something, anything to go on.

[@akmonra]

"I want more ears, I want more paws, I want more bits of cat." - Dr. Mike Pound, 2016

[@kaiserbala7419]

Lol, the changes that has happened over 8 years in generative AI is surreal. mind blown by the leap DL has gone through

[@BazicShotz]

I love videos with Mike.

[@asd49789]

I would be curious to hear his explanation on psychedelic visuals, like what people see on LSD

[@Inertia888]

What is it that makes this computer generated artwork look so psychedelic? It's amazing how accurately this network represents the visual effects of a psychedelic experience. I have not ever seen a human artist represent this in such a way, and I have been looking. I am dying to know if there is some connection between the human brain under the influence of LSD and this network.I would love to get an experienced neurologist and a neural network engineer in the same room for a discussion on this subject. It is fascinating!....will Google make custom prints of this to order ? I need to go find out~~~see ya!

[@novicechef101]

This program is, in my opinion, is scratching the surface using the method our brain uses to relate thoughts and concepts. How images communicate with each other to remind us of things we've seen before, or imagine, or try to visualize. I think these psychedelic looking images, as well as those people might see under the influence of LSDs, are a primitive or low efficiency version of how our brain treats information and images function at normal. I don't know if I'm making sense here, I guess I just mean that our brain produces more requested cost functions with more accurate weights, with a wider selection of weights, at a much much much higher speed, many many many times over. LSDs alter that process, perhaps by slowing down (or somehow else) the entire process of arriving at the normally desired output, and so the resulting trippy images are a magnified version of the normal process. Like stretching out a slinky, the stretched out bit is way different from what a slinky usually looks like. Sorry mate it seems like I'm making no sense lol

[@ianhamilton350]

I think it's because psychedelic visuals/hallucinations are made through a sort of perceptual feedback loop. This is all my own conjecture, but if you think about when you see something out to the corner of your eye and think it's something else, what is happening is that your subconscious goes "oh, that shape kinda looked like a person" and fills in some of the missing features. What happens with psychedelics is that the image of a person generated by your subconscious is then superimposed onto your vision and re-processed, eventually building up a complete image of a person over many iterations. If you think about it in terms of what was explained in this video, there's a pretty clear correlation. "Lower level" hallucinations (colors, shapes, and patterns) would come from your subconscious "maximizing" the lower nodes of the network, and higher level hallucinations (identifiable objects) come from maximizing the higher nodes.

[@jeffbarton3353]

Its "thinking" way faster then our brain usually does.....until you drop some kind of drug on it. This looks exactly like an x-dream. Go figure

[@TheFinalFrontiersman]

@@ianhamilton350 That seems to ba very compelling explanation. I've seen some articles about the few recent psychedelic clinical studies, and they seem to suggest an increase in activity in and between regions of the brain. To me it follows that some of that increased activity could be from the visual processing areas back to the visual perception areas, and that's basically what's going on here, using visual processing data to create an image...

[@alberto467]

Art Project A+. Thanks Google!

[@zacsubach]

I wonder, what if we design a neural network that can learn from 3D models instead of just pictures? Wouldn't the recognition result be better?

[@DasAntiNaziBroetchen]

You think training data grows on trees?

[@__mk_km__]

@@DasAntiNaziBroetchen Well yes. If you want your network to recognize apples that is

[@jony7779]

Better than most art I've seen.

[@heck_n_degenerate940]

I’ve always been interested at how AI image generations feel very similar to the kinds of images you get when half asleep, as your dreams start to form but aren’t fully consolidated. I wonder if it’s coincidental or if this is truly an instrumental part of visualization.

[@troubl3gum]

LSD must have some similar mechanism. these images and the deep dream videos available on YT, especially the famous grocery store video, look extremely similar to what happens with high doses of LSD

[@Arikayx13]

Yep it does, especially in the cases of back propagation, weighted feedback and spill over. Tryptamines in particular turn off areas that dampen feedback (especially in the visual system), causing massive loops which then enhances a small signal over and over until it becomes an extremely large one.

[@Syncopator]

Or rather, it's how the brain works, how it recognizes objects. They don't call it a "neural network" for nothing. What LSD does is increase crosstalk &/or sensitivity in the network.

[@origamigek]

I remember having a similar psychedelic insight. "Omg, we're just pattern-recognizing machines..." I said as I looked at the fractal like clouds repeating is the sky. I was silent for a moment, shocked by this 'hidden truth' I uncovered on acid. But I quickly realized this was quite obvious and nothing to worry about.

[@-dubios-]

xD

[@origamigek]

Autolykos Wut, N2O doesn't get you extremely high. Not to the extend that you would find secrets of the universe. That sounds more like tryptamines.

[@igorthelight]

"It's only for fun!" - Illuminati

[@CalvinHikes]

can someone from his home country verify whether he has a speech impediment or not? I find him difficult to listen to and I don't know if it's his region or if he actually has a different way of talking.

[@billysgeo]

So is the Prisma app based on a lower level neuron network?

[@JR127]

yes

[@billysgeo]

***** Sound reasonable (and looks like it)

[@jasperh6618]

i love the vids with this guy, he's great

[@KeinNiemand]

AI imagiage generation has advanced a lot since then with Dalle 2, Midjourny and stable dffusion.

[@verszi]

i love this guy, he explains these things so well :D

[@sarthakshah1058]

That's the emptiest bookshelf I've seen on a computerphile/numberphile video

[@paltryblather9331]

the picture at 6:41 was not included in the zip file. there is a file named generalimage, but this is actually moreiterations, while the moreiterations file is a cropped version of the same image.

[@zilog1]

he was still rockin windows 7 even 6 years ago. man i wish there was some sort of community driven effort to get windows 7 up and ready for modern use :/ rip win 7

[@X-3K]

11:44 Trypophobiacs: **cringes**

[@roguecactus7]

Lotus seed pods. Fear is the mind killer. 👍 Great video! 😀

[@fermibubbles7407]

best artist ive ever seen

[@Envergure]

Dang, even Cyriac isn't safe from robots encroaching on his job.

[@XnecromungerX]

please correct me if im wrong but does this instantly invalidate all forms of CAPTCHA for bot protection with correct weight editing of a neural network? it will just be able to return a very high probability of letters also googles new reCAPTCHA service, "please click all the pictures with trees" could be completely implied

[@ItsGlizda]

you can even download captcha api and generate your own letter samples to teach your neural network, that's right

[@MRawash]

Alphanumeric CAPTCHAs had already been circumvented by machines a few years back, that is why companies (particularly Google) are moving towards image-recognition based CAPTCHAs now, but it's only a matter of time until that becomes obsolete too. Should be interesting what the next stage will be.

[@user-rh8hi4ph4b]

+Jeraru MC Not really, the classic captchas (letters and numbers) can be solved very easily with comparatively small networks. Really, coding with ANNs has become so easy, programming a bot to deal with the UI will likely take more lines of code than the actual ANN itself.

[@SaHaRaSquad]

I already saw some captchas asking me what monkeys like to eat etc., things that require an understanding of a sentence combined with general knowledge, and I think it will take quite some time until computers can reliably handle that stuff.

[@saltyman7888]

one day, our captchas will have unintentionally become very successful turing test.

[@Cypri666]

I personally think "Google Dream" is an AI system thats learning different images which we upload into it and by doing this they can eventually release a search engine, in the near future based on images. Meaning you can search by images and very accurately.

[@Roxor128]

Doesn't sound terribly useful. Writing is a lot easier than drawing, after all.

[@0pyrophosphate0]

Computers are officially better artists than I am. Wonderful.

[@cow_tools_]

This is so incredible and interesting and I know it's going to be so interesting for AI and recognition, but... I couldn't even look at those last images I was so freaked out. They are just as disturbing as any post-modern human art I've ever seen. Straight nightmare-fuel.

[@richardwatson5437]

Get you some more books! Just being flippant, this was a really cool video.

[@philiprowney]

It needs to be 'aimed' at diseases, specifically genetic ones. For some reason the pastoral scene with the lower level 'thinger' working overtime put me in mind of Cancer. A low-level structure that gets a disproportionation amount of 'attention' and the expression of the excess 'work' is a higher level granularity. Like a fractal with a 'tick' in one of the lower levels of iteration, the natural patterns have no choice but to build on the 'wiggly' pattern set at the < 0.5mm [ the size a typical cancer gets it's own blood supply ].

[@abhinavtembulkar4464]

12:15 _hybrid baby things that give me nightmares_ 😂

[@davidwilkie9551]

If you stacked a series of those together, could you build a slightly mad version of Sherlock Holmes "Science of Deduction" machine? Something for a Dr Who episode?

[@JoeyBamboots]

"I want more ears, I want more paws, I want more bits of cat."

[@Moley1Moleo]

I like how bare the bookshelf in the background is, haha.

[@8bitslime]

This would be a very powerful photoshop tool if you could manually type in what you want. Could you imagine just typing in "remove this tree" and it does it instantly?

[@ShinRa2647]

Got a link for the source code mentioned at the end?

[@michaelpound9891]

Yep! This is the google deep dream code: github.com/google/deepdream/blob/master/dream.ipynb I actually did away with notebook stuff, and just copied the relevant stuff into a large python file, and messed about with it. You'll need to have caffe, python, numpy etc. installed. Have fun!

[@rufioh]

+Michael Pound how easy/difficult is it to train a neural network with images?

[@IceMetalPunk]

It's simple, really. The weight-changing aspect is so standard that by now, you could probably call a single method from a library to do it all for you. The only "difficult" part is that you need to find a lot of images for training and reliably tag the proper outputs. But that's not even hard, since Google Image Search exists XD

[@vintonbonner]

Deep Dream has gotten even better since the time of this video, which as of now was only a week ago. The AI I has actually gone kind of crazy by turning everything into faces of cats and dogs and birds, hybrid fish snail frogs. It's creating new creatures out of other animals' features. It's pretty amazing.

[@wangarangmiao8888]

It's been 6 years, and things has gone pretty wild now :P

[@tho207]

I enjoyed this video like a child! congratulations

[@ericsbuds]

omg the people one! so trippy. I am really intrigued by this. great video!

[@QqJcrsStbt]

When I was in short pants, not a teenager, I was playing with S.LA.M. models on a calculator. Over 40 years later we have made a little progress. Same story, more horse power. Glad I did not hold my breath.

[@SamMcinturff]

when he's gesturing near his monitor with an uncapped marker, it makes me a little nervous.

[@jakayboy]

Best explanation yet

[@l0renzz0]

They think it's just fun. They don't know yet how much of a contribution these videos are for the development of AI.

[@vickielawson3114]

This is cool but it reeeeally bugged me how he left the cap off the marker for so long.

[@TheJacobKing44]

*MAXIMISE THE **_E A R S_*

[@SeriousGamingSteam]

NEED MOAR N E K O!

[@punlovincriminal5564]

Surely he hasn't red all the books on that shelf

[@antipoti]

I wonder why some (if not most) of these images are deeply disturbing. I mean, what psychological alarms does it trigger and why.

[@avior4319]

Did anyone else keep getting distracted by his cool mechanical watch?

[@ASLUHLUHCE]

Rotary mecanique skeleton

[@World_Theory]

I would really like to see a neutral network trained to create vector images by referencing a raster image, and to do it better than the current solutions we have. Perhaps it should be trained with before and after images, where the before images are the rasters, and the after images are hand crafted vector graphics made consistently using good practices (efficient use of vector nodes, etc…), accurate tracing, and a single style. Solid color fills, gradient fills, and pattern fills of shapes, would probably be a difficult thing to teach; it is a difficult thing to learn, even for humans. Having multiple layers to a neural network trying to learn vector graphics can only be an advantage.

[@Autotrope]

I'd be surprised if someone hadn't already done this. Unless it's like facial recognition where there's a more efficient algorithm that works fine.

[@MohanishThe3]

All I see is Trypophobia

[@Andre-oi3yv]

lol

[@Scubadog_]

That eyes/fur picture must've really set some people off.

[@Blazo_Djurovic]

Yup. It didn't trigger me, although google image search can do that to me, but I can easily see how more sensitive people would be getting triggered HARD.

[@voodoopepercorns]

you could foreseeably make a deep dream filter that emphasizes holes in flesh, what a horrible idea.

[@TheMrVogue]

Hello Satan

[@marble296]

You said that it shrinks and blows up the image multiple times. I wonder how much this system relies on digital artifacts as a base to start from

[@benschweiger1671]

people are kind of like deep dream, (is deepdream a GAN?) everyone has different weights that happen throughout their lifetimes and can change a viewpoint. would be an interesting collab, psychology, sociology and neural learning

[@play_sports_and_read_books]

Last images are somewhat haunting

[@jasondalton6111]

Why does Hastie and Tibshirani have to share shelf space with a 2010 C# book? Show respect! 😀

[@ViktorVano]

What is the name of the Google Deep Dream article? Or a link to it, author, please? :)

[@kempyboi123]

Geeeeez, the noise of the pen on the paper makes my back crawl

[@codebeard]

What happens if you maximise the very last layer instead of the one just previous to it?

[@bootygoblin784]

You could have essentially had your entire interview up in those unused shelves tbh.

[@igorbednarski8048]

Am I the only one who is terrified by the cat-like landscapes? I'm not afraid of insects, darkness, horror movies, heights - I don't seem to fear the usual 'scary' things, but this stuff gives me horrific creeps.

[@Wabajak13]

Goodness gracious I feel like I am learning so much but these pictures make me so uncomfortable. Truly other worldly and horrific.