What are neural cellular automata?

  Рет қаралды 164,150

Emergent Garden

Emergent Garden

Күн бұрын

Explore NCAs yourself: neuralpatterns.io
This is a more thorough description of neural cellular automata, specifically those found in neuralpatterns.io.
COOL STUFF:
Growing images with NCAs: distill.pub/2020/growing-ca/
Convolutional Neural Network visualizer: www.cs.ryerson.ca/~aharley/vi...
Desmos: www.desmos.com/calculator
MUSIC:
The Acolyte: • Absence
Godmode: from youtube's music library. Not sure where to find that publicly.
TIMESTAMPS
(0:00) Intro
(0:40) Cellular Automata
(2:04) Neural Cellular Automata
(3:49) Filter + Convolution
(5:21) Activation Function
(7:13) Worms

Пікірлер: 191
@EmergentGarden
@EmergentGarden 2 жыл бұрын
I mentioned it briefly in the video, but didn't clarify it super well. The filter is inverted, meaning it's flipped over both it's x/y axis. This results in an inverted pattern, and this implementation is pretty common for convolutions. I may explain in a future video why I find this more intuitive, where a visual aid would be very helpful. Hope this clarifies any confusion!
@jucom756
@jucom756 2 жыл бұрын
i thought already that it seems more like an outwards effect filter than inwards, since if i made a 1 in the bottom left it didn't get the cells the value from the bottom left, it exported the cells value to the bottom left cell.
@vkessel
@vkessel Жыл бұрын
Unlike cross-correlation (not transposing the matrix), convolution has many sexy properties in regards to commutativity, distributivity complex conjugation, differentiation, and fourier transforms. You can merge kernels into one bigger one because of associativity, just note most machine learning libraries implement it as cross correlation since the weight are learned.
@hekuli
@hekuli 11 ай бұрын
There’s a good visual explanation of the inversion here kzbin.info/www/bejne/gaa7m6p4abGtiaM
@hyperteleXii
@hyperteleXii 2 жыл бұрын
The cells don't have to be arranged in a square grid. They often are, because that's an easy and efficient way to quantize space in computer memory; But they don't *have to* be. You could also have hexagons, or triangles, or indeed an irregular graph of random points.
@EmergentGarden
@EmergentGarden 2 жыл бұрын
Yeah lots of cool variations, I just simplified it to give context for NCAs.
@overloader7900
@overloader7900 2 жыл бұрын
Technically, so long you use coordinates(as in perpendicular XY), you will always will be on a 'square' grid, even with floats.
@hyperteleXii
@hyperteleXii 2 жыл бұрын
@@overloader7900 That's incorrect.
@willmungas8964
@willmungas8964 2 жыл бұрын
@@overloader7900 well not necessarily; but you would always have something that can be mapped to a square grid
@Aras14
@Aras14 2 жыл бұрын
Also the cells could have other values, like 0.5. I don't think, a simplified definition being used in the video is bad, but the following would be a more general defenition: A cellular automata is made up of cells arranged in a grid that have values. The values of the next timestep are calculated via a convolution of the previous timesteps values.
@6AxisSage
@6AxisSage 2 жыл бұрын
This just cracked open my mind to all kinds of new possibilities and ties right in to existing skills ive already developed. Thank you so much for the work you put into this video ❤
@Milark
@Milark 2 жыл бұрын
I commented “this is the most underrated channel under 1000 subs”. And now you have 2.13k a few days later. Love to see it.
@flamencoprof
@flamencoprof Жыл бұрын
Woah! this is another level above the cellular automata (and fractals) I was playing around with forty years ago on my Commodore 64, thanks to a column in Scientific American. BASIC was too slow and I had to learn opcodes to do the actual cell processing, with operations directly on the screen memory.
@jonaw.2153
@jonaw.2153 Жыл бұрын
This is the kind of stuff Computer Science should be about. Not creating the architecture for the newest dating algorithm. This is what the world needs right now.
@SpencerYonce
@SpencerYonce Жыл бұрын
These are the coolest videos I’ve ever seen. I’ve been coding shaders in glsl for a couple years now, and you just gave me a ton of ideas. Thank you
@micahconnor8954
@micahconnor8954 2 жыл бұрын
your program is fascinating, it almost feels dream-like. I'm having a lot of fun slightly tweaking numbers on the worm pattern to see all the new results. I feel like layers of the universe have been pulled back, and I'm getting to see how all the things function through relatively simple numbers!
@Fybir_
@Fybir_ 2 жыл бұрын
Your channel is a hidden gem, I just watch your videos on repeat in the background when programming
@o_enamuel
@o_enamuel 2 жыл бұрын
i think your channel is going to grow pretty fast it isnt common to see so good content so early
@connormc4050
@connormc4050 2 жыл бұрын
Your videos are getting so much better!
@immanuelt613
@immanuelt613 Жыл бұрын
Fascinating stuff, please never stop.
@jyly261
@jyly261 2 жыл бұрын
I was litirally just watching all your videos and was just out of content lol. For my highschool project I'm also making a natural selection simulation. But your life engine is so much more interesting and made me wish I saw this earlier so I could make something more like your life engine. Anyways your videos are so interesting keep it up :).
@DissyFanart
@DissyFanart 2 жыл бұрын
Same here lmao
@k98killer
@k98killer 2 жыл бұрын
Have you figured out all the details of how it will work?
@PunmasterSTP
@PunmasterSTP 2 жыл бұрын
I'm just curious; how is work on your program going?
@OnaRocketship
@OnaRocketship Жыл бұрын
thank you for joining us in the journey to the digital micro verse.
@tensenpark
@tensenpark 2 жыл бұрын
Love this video, impressive work! Short comment though: This is not neural cellular automata. The neural part is of CA is TRAINING the Neural cellular automata so that the filters learn to replicate existing patterns. That's what's neural about it. In this video the filter values are a given. The way it's explained is more akin to implementing continuous cellular automata with activation functions.
@PunmasterSTP
@PunmasterSTP 2 жыл бұрын
Rarely do I come across a video as inspiring as yours. I've dabbled in simulating a reaction-diffusion system as well as population dynamics, but this just makes me excited to explore even more! Thank you so much for making and sharing this video.
@TheRainHarvester
@TheRainHarvester Жыл бұрын
Nice to see you here samter! I like your channel too.
@PunmasterSTP
@PunmasterSTP Жыл бұрын
​@@TheRainHarvester I'm glad to be here, and thank you for checking out my channel! I just have to say that there's just so much other, better stuff out there too. For instance, I recently ran across Dave Ackley's channel, and he's a professor who works on artificial life whose whole channel just has a really nice vibe. kzbin.info
@JellyMonster1
@JellyMonster1 Жыл бұрын
Excellent video - just the right pace for me and well explained.
@orenong
@orenong 2 жыл бұрын
Thank you so much! I had so much fun with it!! I made this function float activation(float x) { float y = 1./(1.+pow(2.7182,-x)); float z = ((x/y) + (y/x)); if (x
@Tumbolisu
@Tumbolisu 2 жыл бұрын
the "return z/x" part should always make a number greater than 1. is this intendet?
@vegnagunL
@vegnagunL 2 жыл бұрын
Really good channel. This is a hidden gem. Keep it up.
@VoidloniXaarii
@VoidloniXaarii Жыл бұрын
Fascinating, thank you for showing this
@rosiefay7283
@rosiefay7283 Ай бұрын
3:54 It can also be pretty easy to * choose colours that are not bright and not vivid; * present a CA run as a slide-show that the user can step through, rather than a movie.
@TodePond
@TodePond 2 жыл бұрын
this video is so SOOTHING and INTERESTING, thank you!!
@l-l-l-l-l-l-l-l-l
@l-l-l-l-l-l-l-l-l 2 жыл бұрын
I remember that paper from a 2 minute papers video this looks really cool
@Diamcreeper
@Diamcreeper 2 жыл бұрын
It would be cool to see a part two about how the more complex cellular automata work, such as the self regenerating ones you've mentioned
@EmergentGarden
@EmergentGarden 2 жыл бұрын
I'm planning to play around with them more!
@alacer8878
@alacer8878 2 жыл бұрын
@@EmergentGarden I can't wait to see the upcoming video then!
@Fybir_
@Fybir_ 2 жыл бұрын
You are so inspirational, your videos have really helped me in making my own evolution simulation game thing
@rgbtryhardled636
@rgbtryhardled636 2 жыл бұрын
working on a neural automata in c++, just found this great channel, subbed
@caiomotta8910
@caiomotta8910 Жыл бұрын
Cool vid. Looks like a sweet place to try out different reaction diffusion patterns.
@dyllanmccreary688
@dyllanmccreary688 Жыл бұрын
I work on NCAs and this is an amazing video that gave me a much cooler intuition
@i0am0superBlast
@i0am0superBlast 2 жыл бұрын
I was messing around with the worms save (essentially keeping the code part the same) and stumbled upon an interesting filter. It has a few rules that I noticed: 1. When I wiggle the mouse around quickly enough in a small enough area, a blob will start to form and grow. But these blobs come in two variations (which I haven't figured out how specifically create one type or the other. My only guess is how concentrated they get before they start growing?) that forms a wall between each other. 2. Two blobs of either Type 1 or Type 2 will absorb into each other when they meet, but when a Type 1 and a Type 2 meet each other a wall is formed. 3. If one type engulfs a smaller opposite type, if the opposite is small enough it will get eaten. 4. Finally, a Type 1 will become a Type 2 (and vice versa) when wrapping the screen vertically, but for some reason stays the same type when wrapping horizontally. Such odd behaviour from something like this. Rules are created from something that doesn't inherently have those rules. Not as interesting as finding something that looks like watching bacteria, but something neat nonetheless. If you want to see for yourself, just load up the worms save and use this filter: -0.1 0.7 -0.1 0.7 0.0001 0.7 -0.1 0.7 -0.1
@adsilcott
@adsilcott 2 жыл бұрын
I started with the Worm save, entered the filter above, and hit Reset State. The resulting pattern is interesting, but nothing like what you described. Are there any other settings to modify to recreate it?
@i0am0superBlast
@i0am0superBlast 2 жыл бұрын
@@adsilcott In the reset options, hit clear to give the screen a blank slate. Then you can move the mouse around to make the bubbles. You should notice how some of the blobs you make merge and some refuse to merge at all. Eventually that will all expand to fill the screen. It should still do it even when you hit reset, it just creates blobs all over the place and might be hard to notice the rules I notice at play. And also remember that there isn't any visual way to tell the difference between the two blobs until two of them meet. Hopefully this clears it up for you. If not, then I'll try to explain better, or maybe upload a video or something lol.
@mdoerkse
@mdoerkse Жыл бұрын
Sounds like the two types are offset from each other, like the black and white bishops in chess. Just a guess.
@ThefamousMrcroissant
@ThefamousMrcroissant Жыл бұрын
It's wonderful isn't it? I had the same feeling of being onto something deeply profound when playing with rendering fractals. Lovely little video!
@mayae9372
@mayae9372 Ай бұрын
I am considering using this for my master's thesis in music composition. Thank you for sharing your knowledge :D
@DG123z
@DG123z 10 ай бұрын
Love your videos. I feel we are getting at the very fundamentals of the universe.
@PixeLabor
@PixeLabor 2 жыл бұрын
your videos are so good
@nuip7936
@nuip7936 2 жыл бұрын
very cool video, youre so underrated its a crime
@nanaki1990roblox
@nanaki1990roblox 7 ай бұрын
Excellent video. Thank you
@douggggggg
@douggggggg Жыл бұрын
this is a beautiful picture
@infocentrousmajac
@infocentrousmajac Жыл бұрын
Amazing work... I got interested in these topics about a year ago when
@Graverman
@Graverman 2 жыл бұрын
great video and it is truly amazing how far Cellular Automata has went. Is there any communities around this stuff? Like subreddit or discord server that you are part of?
@dushkin_will_explain
@dushkin_will_explain Жыл бұрын
Очень интересная идея. Взял себе в разработку для курса по клеточным автоматам.
@zealot4325
@zealot4325 Жыл бұрын
Thank you for this interesting video
@emzee1148
@emzee1148 2 жыл бұрын
Love your work
@sadpikachu409
@sadpikachu409 Жыл бұрын
Hii, this is very interesting. Could you make a part 2 on a more detailed explanation of different patterns and its results?
@7Cetus7
@7Cetus7 2 жыл бұрын
Great video! Needs more views!
@billallen275
@billallen275 Жыл бұрын
That's what thoughts look like. Immediate impression. Way cool.
@DanielJoyce
@DanielJoyce 2 жыл бұрын
So Conway's game of life is basically a edge case of NCA.
@kayaba_atributtion2156
@kayaba_atributtion2156 2 жыл бұрын
great content!
@claudihallo6695
@claudihallo6695 10 ай бұрын
Ich habe vor 40 Jahren meinen ersten Kontakt zu "LIFE" und dies auch selbst programmiert. Es war schnell klar das man aufpassen muss den Begriff "Zeitlichen Ablauf" nicht aus den Augen zu verlieren. Also habe ich aus dem fiktiven "Jetzt" Situation erst komplett getrennt das "Next Step" errechnen lassen und dies mit einfachen Inkrement Befehle weil das eben schnell gegangen ist. Jede Zelle wurde nur zweimal angesehen vom Programm. Dann das "jetzt" gelöscht und das "Next Step" zum "jetzt". Wenn man das nicht macht bekommt man Effekte als wenn man mit einer altmodischen TV Kamera auf den von der Kamera aufgenommenen Wiedergabe Röhren TV drauf hält. Eine Rückkopplung des Analogen Bildsignals. Das scheint hier das gleiche Verfahren zu sein und man darf nicht vergessen das die alten Bildröhren TVs das Bild von oben nach unten und links nach rechts gezeichnet haben. Hier ist es evtl. eben Digital ein "Jetzt" und "Next Step" Problem im Grunde fehlerhafte Ausführung der Funktion.
@snoozingnewt
@snoozingnewt 2 жыл бұрын
This is awesome - do you have any plans to develop say, a forum/site where we can share cool patterns we find?
@Anzeljaeg
@Anzeljaeg Ай бұрын
Great video 🎉
@terryr9052
@terryr9052 2 жыл бұрын
Very cool! Has any work been done with adding additional convolution/activation layers?
@turun_ambartanen
@turun_ambartanen 2 жыл бұрын
If you want to be serious about the epilepsy warning on your website you must not make the animation autoplay. It would also help to make the warning a big, central popup with a prominent "yes, I understand" button and a "no, close web page again" one.
@EmergentGarden
@EmergentGarden 2 жыл бұрын
The autoplay pattern is configured so it can't be very flashy, I figured it was safe enough. My intuition may be wrong though, I will eventually make the popup more prominent
@turun_ambartanen
@turun_ambartanen 2 жыл бұрын
​@@EmergentGarden I'm not an expert on epilepsy and what triggers it. Clicking/Reloading through some random patterns I agree that they are not directly flashy, but certainly jarring. Some do develop a flashing pattern after a short while though. (Now that I think about it, a big part could be my monitor and the relative size of one real pixel to one pixel in the simulation. If I zoom in there is indeed no flashing going on). After a few reloads I got the following pattern that quickly develops into flashing patches on my monitor: 0.1049 -0.5843 0.6364 -0.5714 -0.644 0.9084 0.8545 -0.4166 -0.7815 With the default identity function.
@CyCloNeReactorCore
@CyCloNeReactorCore 2 жыл бұрын
awesome video :)
@hanyanglee9018
@hanyanglee9018 2 жыл бұрын
Feature required: new function to map value to color. Mirror the core on both direction to match the convention in CV.
@Gosuminer
@Gosuminer 2 жыл бұрын
This is beautiful and fascinating. Thanks to computers and browser tools like yours everyone can do experiments about emergence which would be a great opportunity for those who rather stick to the theory of an intelligent creator as opposed to very simple initial conditions that eventually lead to high complexity.
@ChicoCuantico
@ChicoCuantico 2 жыл бұрын
And what was the source, or the origin, of that "simple" initial conditions?
@Gosuminer
@Gosuminer 2 жыл бұрын
@@ChicoCuantico We don't know yet but it does not have to have been an intelligent entity.
@evanbecraft8201
@evanbecraft8201 2 жыл бұрын
@@Gosuminer I like thinking that there is no point in arguing since it’s technically impossible to ever define the start of the existence of anything. I am not religious but I cannot deny it likely will never be found what came before the universe, if there are other universes, etc. therefore I cannot actually disprove higher powers. I do believe that god doesn’t affect anything if he were to exist but I certainly cannot rule out the fact that we will never know if he did
@thalesfm
@thalesfm Жыл бұрын
Awesome video! Here's a suggestion: You could generalize the idea of neural cellular automata by allowing cells to contain additional state variables besides just alive/dead; with a single additional variable, for example, you could simulate some pretty interesting reaction-diffusion systems!
@MrHichammohsen1
@MrHichammohsen1 Жыл бұрын
Truly mind blowing! Thank you for all the videos.
@ofekshochat9920
@ofekshochat9920 2 жыл бұрын
I don't know if this is already implemented, but for the life engine, maybe having something like an eye, which is a combination of some cells, only be possible to produce if there's a specific pattern. So for example yoh have to have maybe some 'useless' ones until you can get an eye. Another example could be hands and throwing things. So you have to evolve some kind of something similar to hand, to have thay
@olivierhepler412
@olivierhepler412 Жыл бұрын
Hi Emergent Garden I loved ur video! I am currently studying cs and cog sci in Canada and recently undertook a project where i tried to model a certain evolutionary behavior with a ca. This video is fascinating, where do you recommend I read up more on neural ca's, seems like a fascinating next project?
@Skynet_the_AI
@Skynet_the_AI 2 жыл бұрын
Yes. Accurate interpretation!
@Bvic3
@Bvic3 2 жыл бұрын
What tool did you use to visualise the convnet with the 9 drawing in 3D? Really intuitive visualisation.
@shoo7130
@shoo7130 Жыл бұрын
If you set the centre weight for Conway to 0.5, then you can do a simple range test between 2.0 and 4.0. 3 neighbours is always less than 4, and 2 neigbbours + 0.5 is greater than 2. Then maybe subtract 3.0 from that and use 1 - abs() or whatever.
@pi314159265358978
@pi314159265358978 2 жыл бұрын
Nice! Is there a place to share interesting filter values that one finds?
@vibaj16
@vibaj16 2 жыл бұрын
didn't expect to find you here
@MikeTooleK9S
@MikeTooleK9S Жыл бұрын
i'm sure I'm not the only one who sees it, so eventually we're going to have violent video games where the characters health is gonna be based on this principle. walking around the scene like Westworld automatons.
@milsantosvideos
@milsantosvideos 2 жыл бұрын
Great, thank you very much!
@phillipmiller3302
@phillipmiller3302 Жыл бұрын
The wall was too high As you can see No matter how he tried He could not break free And the worms ate into his brain
@randolphexmachina6376
@randolphexmachina6376 Жыл бұрын
very cool
@ukrainiansturgeon8561
@ukrainiansturgeon8561 2 жыл бұрын
Imagine a 3D version of the life engine
@Jennn
@Jennn Жыл бұрын
Guys, we just fell through the rabbit hole~!
@kleenbeats
@kleenbeats 2 жыл бұрын
I can’t wait until you learn about modular synthesis!
@Illogical.
@Illogical. Жыл бұрын
The first thing, I ever made in Python was Conway's Game of Life, but on a hexagonal grid, and with looping edges. It was finished less than 24 hours after I started learning Python, which was a few days ago.
@NoSTs123
@NoSTs123 Жыл бұрын
sounds fun. either you are extremely good at picking up programming language or it isn't as hard as I thought. Anyways, you convince me to learn it this fall.
@Illogical.
@Illogical. Жыл бұрын
@@NoSTs123 That's awesome! I know how I teach myself things efficiently, I had already taught myself a some minecraft bedrock edition command block stuff and Scratch before, but always got stuch because of those programming languages' limitations (mostly the fact, that the code can not add new variables.). Python is a good place to start learning programming.
@NoSTs123
@NoSTs123 Жыл бұрын
@@Illogical. Thanks
@Illogical.
@Illogical. Жыл бұрын
​@@NoSTs123 From the way, that you wrote your comment, it seems like there are similarities between how we think. That is a good thing.
@Illogical.
@Illogical. Жыл бұрын
​@@NoSTs123 It's not either, or. Both are true.
@asdf8asdf8asdf8asdf
@asdf8asdf8asdf8asdf Жыл бұрын
Probably best for modeling neurogenesis, and group neuronal differentiation in developing organisms.. of all kinds.
@Bananananamann
@Bananananamann Жыл бұрын
Very cool. Now we need a generic algorithm that modifies the filter and has a fitness function based on how many other species are currently in the picture as well as how much space it takes (fitness = diversity + dominion) and have several species live on the grid at the same time. Evolution all over again
@CristianGarcia
@CristianGarcia 10 ай бұрын
Hey, enjoyed the video, thanks! On a technical note, the original paper did learn a function that generates the final pattern so the "neural" part makes sense, however, in your case it seems there is no learning and you are only applying a filter + activation function. Maybe "continuous" cellular automata is a better term than neural?
@dragolov
@dragolov 2 жыл бұрын
Respect!
@rosiefay7283
@rosiefay7283 Ай бұрын
5:44 *real value. ("Decimal" refers to one way to notate numbers, not the numbers themselves.)
@RafaelSCalsaverini
@RafaelSCalsaverini 2 жыл бұрын
Is there a random number generator in the language used for activation functions? I wanted to add some noise too the activation but couldn't find any rand() or random() function.
@PixeLabor
@PixeLabor 2 жыл бұрын
would be nice to be able to change the simulation speed and the size of the mouse pointer to see what is happening if one breaks up structures
@crocus8080
@crocus8080 Жыл бұрын
I love this thing! It reminds me of the backgrounds of Yume Nikki, I feel like this sort of thing would feel right at home in a weird little rpgmaker game.
@R2Bl3nd
@R2Bl3nd 2 жыл бұрын
Warping the grid would be cool, like how gravity works under relativity. The higher the value at a space, the smaller it shrinks, down to a minimum size. The scaling effect would have to warp its neighboring spaces on each simulation step to simulate a gravitational wave, which would propagate out in all directions, and cause the strength of the warping to drop off with distance. You could play around with all those parameters, as well as functions that determine the amount of shrinkage, and how the warping space effect spreads. The convolution would have to be scaled based on the size of the space I guess. And I also think that the convolution would have to be applied to the warped version of the grid, somehow, like via a projection onto the warped version of the grid. As for how you'd warp time, if you wanted to make it even more relativistic, I'm not exactly sure, but it would be cool if that could be done as well.
@Rudxain
@Rudxain 2 жыл бұрын
Now I wonder what would be the behavior if we could quantum-entangle cells based on how much they interact (I know this is not how QE works, but redefining existing physical phenomena makes it more interesting)
@SirPlotsalot
@SirPlotsalot Жыл бұрын
You could achieve time-dilation by applying a convolutional expression of relativity. Using a sigmoid over the "uncapped" velocity of each cell provides a naïve approach, but why not use some numerical approximation of Einstein's field equations, applied as a further convolution over the input? Let's consider our world as having arbitrary base units, analogous to SI base units for simplicity. We can let each cell be a 1 m^2 surface in our 2D gridworld, with energy equal to the value of the cell. You could even go wild and use another activation function, or a separate convolution over the input to compute said energy. Each cell must therefore have a mass, and a (2D) density - we can choose the fundamental constants of reality in our model to be the same as real life, or we could choose a completely new set if we really felt like it with potentially wacky results. The equations we've derived that best describe the universe we inhabit don't require the constants to be any value in theory, we just found out what they are for OUR universe. Let's treat "energy" as a measure of the kinetic energy of the particle; you could even separate out into two channels for representing energy and mass separately. We don't necessarily need to however, and we could just treat each cell as having a rest-mass of 1 unit. Taking this approach, let's extrapolate out our model into 3D. Sounds weird for a grid, but the third dimension in this case is time. The "3D space to 4D spacetime" is what's known as a Minkowski space, so let's consider the 2D to 3D version as a similar enough thing, with a Euclidian (flat) geometry under the absence of curvature. This brings us to the "bending" analogy, but with visualisations that are actually understandable to us - the lycra-sheet demo of bending 2D planes into 3D objects. Adding in a channel for rest-mass and taking a 3D convolution over both channels at once should be sufficient to represent the spatiotemporal interaction. TL;DR - use a 3D grid with one layer for kinetic energy and the other for rest-mass, then use a rank-3 tensor as a kernel rather than a rank-2 tensor (matrix) to do a 3D convolution.
@R2Bl3nd
@R2Bl3nd Жыл бұрын
@@SirPlotsalot thanks so much for the thoroughly thought out reply. I'm a software engineer but that's beyond my current level of understanding. I'd love to make an app or something that lets you play around with gravity and such, all the parameters you were talking about. I think if more people got to play around with physics like that, more people would be into it.
@SirPlotsalot
@SirPlotsalot Жыл бұрын
@@R2Bl3nd i would definitely read up on deep learning stuff, it's so useful for this sort of understanding
@R2Bl3nd
@R2Bl3nd Жыл бұрын
@@SirPlotsalot yeah will try eventually. I'd have to try to keep it interesting though, I usually make some kind of game or dynamic simulation to accompany some concept I'm learning.
@sitryk3362
@sitryk3362 Жыл бұрын
Would there be much effect if the shape/size of the filter changed depending on a cells current value?
@danishdebater5805
@danishdebater5805 2 жыл бұрын
This is very interesting. Are there anyway to gain the value of the active cell in question in addition to the calculated kernel value?
@danishdebater5805
@danishdebater5805 2 жыл бұрын
That is, could an float activation(float x, float cell) { return x*(cell^2); } Or some such be added?
@EmergentGarden
@EmergentGarden 2 жыл бұрын
I've thought about it! I may eventually add an option to expose that value, but for the moment you cant do it through the UI. If you don't want to wait for me the project is open source: github.com/MaxRobinsonTheGreat/webgl-convolution
@danishdebater5805
@danishdebater5805 2 жыл бұрын
@@EmergentGarden thank you. I do hope you will add it at some point, kernel 4 if I'm not mistaken? But yea, already opened it & started to go over the code. Not a strong js wiz, but it seems doable :)
@36nibs
@36nibs Жыл бұрын
Ahh yes the spaghetti space monster very nice 🧐
@mrl9418
@mrl9418 2 жыл бұрын
"Strange, computational microverse"
@Techischannel
@Techischannel Жыл бұрын
When i saw this video's thumbnail i thought of something way different.
@HuntokarVersus
@HuntokarVersus 2 жыл бұрын
I tried just inverting the gaussian activation function and didn't get the worms, but I did notice worm-like patterns in the noise, so based on my shader experience i tried putting a "hardness" exponent on the pre-inversion gaussian and that seems to be at least close to right float activation(float x) { float hardness = .6; return 1. - pow(1./pow(2., (pow(x, 2.))),hardness); } You can adjust hardness a bit and still have something like worms, but 0.1 in either direction will result in collapse to black or expansion to the kind of screen filling pattern you get without the exponent. I don't think this is EXACTLY the function shown here but hey.
@gregpud3471
@gregpud3471 2 жыл бұрын
Wow. Just found settings which creates sierpinski triangle from a middle point!
@danaililiev1404
@danaililiev1404 Жыл бұрын
So we do live in a simulation
@rickybloss8537
@rickybloss8537 2 ай бұрын
On the brain of an ape yes.
@ALEXGIBSONCMG
@ALEXGIBSONCMG 9 ай бұрын
Based Desmos enjoyer
@JacobRy
@JacobRy 2 жыл бұрын
Are the number of layers and neurons determined before hand? Or would the num of neurons be the number of cells.
@Zero-4793
@Zero-4793 2 жыл бұрын
6:25 looks like a good simulation of sand dunes
@nevokrien95
@nevokrien95 Жыл бұрын
I think i could program this qt my own computer in like 30 minutes. Sounds like fun
@jmejuniper
@jmejuniper 4 ай бұрын
Really cool! Just sharing a few things I made here: Conway's Game of Life, but generalized to floats ``` {"reset_type":"center","filter":{"0":1,"1":1,"2":1,"3":1,"4":10,"5":1,"6":1,"7":1,"8":1},"hor_sym":false,"ver_sym":false,"full_sym":false,"activation":"float activation(float x) { \tif (mod(x,10.0)>=1.5&&mod(x,10.0)=3.0) { \treturn x/10.0+1.0; \t} \t \treturn x/10.0-1.0; }","color":[1,0.1803921568627451,0.1803921568627451],"bg_color":"#000000","persistent":false,"skip_frames":false} ``` Interesting thing about this is that the pre-loaded game of life and I both used almost exactly the same approach? They made the more reasonable decision of using 9, and I used modulo to compress the code, and of course later made it into ranges instead of integers. Still interesting, though. Watercolor paintbrush ``` {"reset_type":"random_bool","filter":{"0":0.10000000149011612,"1":0.3499999940395355,"2":0.10000000149011612,"3":0.3499999940395355,"4":-0.05000000074505806,"5":0.3499999940395355,"6":0.10000000149011612,"7":0.3499999940395355,"8":0.10000000149011612},"hor_sym":true,"ver_sym":true,"full_sym":true,"activation":"float activation(float x) { \treturn x/1.75; }\t\t","color":[1,1,1],"bg_color":"#000000","persistent":false,"skip_frames":false} ``` Tried to recreate some sort of watercolor paintbrush. Paint dissapates and expands for a little bit before settling into a stable state. If you need a brighter color, paint more over the same spot
@Nathouuuutheone
@Nathouuuutheone 2 жыл бұрын
What do you mean "the filter is inverted from the panel"? You only show the filter with an outline, you're not showing what/where the reflection is and you're not even saying why it's intuitive or why the opposite would be unintuitive.
@jucom756
@jucom756 2 жыл бұрын
if i could programm with glsl thsi would be so cool, but i'm stuck at python level, i can get a basic understanding but i don't know how to properly use the operators etc, so if i write code it's very unoptimal (still some cool interactions i could get by trying to make a modulus filter to get positional info out of x, but that was with 5 if-statements in something i could've done in 2 python lines...)
@yiannchrst
@yiannchrst 2 жыл бұрын
Wow, didn't know you were active.
@Corbnorb
@Corbnorb 2 жыл бұрын
what is the inverted bell curve activation? you never showed the math or said the name of it and i really want to try to make it!
@marczas
@marczas 2 жыл бұрын
I wanna combine this with something like Deepdream by Google or better - new Gaugan by Nvidia. Of course everything generated in real time with the option of layers - that would be interesting to watch, especially on high :D
@Saw-qv3bl
@Saw-qv3bl Жыл бұрын
4:52 What do you mean by Inverted?
@monad_tcp
@monad_tcp Жыл бұрын
Now add all the string theory rules and create the entire universe in the simulation.
@berkansivrikaya9055
@berkansivrikaya9055 2 жыл бұрын
this shit is crazy yo!
Code that Writes Code and ChatGPT
19:29
Emergent Garden
Рет қаралды 237 М.
Watching Neural Networks Learn
25:28
Emergent Garden
Рет қаралды 1,2 МЛН
ОДИН ДЕНЬ ИЗ ДЕТСТВА❤️ #shorts
00:59
BATEK_OFFICIAL
Рет қаралды 6 МЛН
Wait for the last one! 👀
00:28
Josh Horton
Рет қаралды 96 МЛН
A Cell that Kills Everything (Life Engine)
11:01
Emergent Garden
Рет қаралды 225 М.
Cellular Automata: Complexity From Simplicity
13:03
Acerola
Рет қаралды 94 М.
Organic neural cellular automata
9:05
Emergent Garden
Рет қаралды 46 М.
Let’s BUILD a COMPUTER in CONWAY's GAME of LIFE ⠠⠵
23:33
Alan Zucconi
Рет қаралды 971 М.
How are memories stored in neural networks? | The Hopfield Network #SoME2
15:14
I programmed some creatures. They Evolved.
56:10
davidrandallmiller
Рет қаралды 4 МЛН
I Made a Neural Network with just Redstone!
17:23
mattbatwings
Рет қаралды 641 М.
Inside a Neural Network - Computerphile
15:42
Computerphile
Рет қаралды 425 М.
This is NOT a Tesseract.
13:13
Kyle Hill
Рет қаралды 300 М.
✨ NEW Cellular Automata
12:28
TodePond
Рет қаралды 114 М.
iPhone 12 socket cleaning #fixit
0:30
Tamar DB (mt)
Рет қаралды 49 МЛН
Купил этот ваш VR.
37:21
Ремонтяш
Рет қаралды 293 М.
Asus  VivoBook Винда за 8 часов!
1:00
Sergey Delaisy
Рет қаралды 1 МЛН