Grid Cells (Episode 14)

[@nikosk.736]

This video deserves a lot more views.

[@NumentaTheory]

You can help by sharing it with your friends over social media or email. :)

[@lextr3110]

the views will grow exponentially for sure

[@tyfoodsforthought]

The whole series deserves a lot more views! It's cool to be early. 😎

[@zacheberhart1564]

What an incredible explanation of such complex ideas -- well done and thank you!

[@robertpfeiffer4686]

Bravo! One of the best HTM School videos yet. Follow-up questions: 1) What evidence exists that our spatial concepts underlie our temporal concepts? 2) What evidence exists that our egocentric concepts underlie our allocentric concepts?

[@robertpfeiffer4686]

One other follow-up question: Do you think that it will turn out to be the case that the entities which were depicted as individual grid cells in this video will turn out to be layers (L6b) of individual cortical mini-columns?

[@KonstantinosSamarasTsakiris]

Hi! I'd cite a paper by E. Moser (mentioned in the video) to provide arguments on this question: www.researchgate.net/publication/235376121_Memory_navigation_and_theta_rhythm_in_the_hippocampal-entorhinal_system

[@KonstantinosSamarasTsakiris]

@HTM School perhaps it's a good addition to your list of papers?

[@NumentaTheory]

I don't think so (that's me Matt speaking). Jeff might think otherwise? I don't know.

[@NumentaTheory]

1) temporal without spatial is nearly meaningless. It's like a 1D array. You MUST process more than that to understand reality. Adding "spatial" to the mix means each data point in the 1D array can contain a wealth of information. It's just how reality is, and it makes sense to me that's how the brain represents it. :) 2) I'm not sure, this might not have experimental evidence. This is theory you know. ;) Good thing is that it can be tested.

[@jiaweizhang491]

Thanks, Matt, this is the most intriguing lecture I have ever had on KZbin, I happened to come up with similar ideas like the SDRs myself earlier in graduate school and when I meet the HTM theory, immediately I found this is the 'home'. Thanks again for those wonderful episodes!!

[@odieostrich7718]

did you follow up on the SDRs representing concepts ? Will you?

[@philoneill9865]

This is amazing. I play drums and while playing I feel like I am moving through space, moving through something, slightly upward and to the right. Although I am sitting still. I wonder if other musicians feel like they are moving. Anyway, this is a really amazing video and I am glad that they are giving the brain its due.

[@grokspeed]

Hey Matt and team. Just binge watched all 15 episodes in two days and appreciated how both the production quality and your hairstyle evolved for the better over the years. Great job well-done. The visualization helps tremendously.

[@enggei]

Great video! I have been following both Numenta and the Moser's work for years and I am thrilled to see Numenta incorporate the Nobel price winning work into their models. Exciting times indeed!

[@chantelleboutin]

This one was really great. It helped bring some of the concepts together. Please keep going.

[@hyunsunggo855]

this gives me chills.. no doubt that this'll contribute to the future of HTM a lot!

[@Pencilbrush1]

Im new to programming and an old fan of Jeff and i will promote this channel as much as humanly possible .

[@Pencilbrush1]

One of the principal reasons I'm getting into python and programming is HTM theory and Numenta

[@GNARGNARHEAD]

you guys never cease to inspire :D I can't wait to hear all about the tricks of grid cells xD have a good one, and thanks again

[@JeffHykin]

That animation did a fantastic job of explaining the concept. While this makes huge steps in terms of understanding the brain, it also has some really important implications in computer science and mathematics. The qualities are truly astounding: - tolerant to inaccurate input - probablistically provide location - accurate measure of change (velocity in particular directions) - accuracy benefiting from high dimensionality - similar features being nearby in space - allowing for feature overlap (does not require probabilisticly independent inputs) From a mathematical view, I think it was unclear whether or not that kind of mapping was even possible with finite discrete input. Cryptography and Search engines could likely benefit from this kind of uniqueness mapping of various different features.

[@NumentaTheory]

Thanks so much! :D

[@arielperez3434]

Wow this is awesome. Watched the entire series in two days, excited for what's to come!

[@DavidRagazzi]

From 12:35 the best part of the video: we see concepts in a spatial perspective! It's just remember that when are learning mathematics in school we make simple operations using visual objects like fruits or hand fingers to understand the results. Furthermore, this new theory explains why is so dificult to us imagine some things like the size of the universe: so many spatial references to draw a big frame of it! Physics, for instance, is all about imagination: you must imagine objects or particles interacting between themselves to understand concepts. This only is possible if your brain manage positions of objects as well their features (compositionality). The new theory (1000s of brains) will clear many lacunes of machine learning not filled by the current approachs.

[@NumentaTheory]

You get it, David!

[@hernandezurbina]

awesome video, Matt! Great work

[@MichaelRicksAherne]

This is some awe-inspiring stuff. I'm ready to dive into the open-source. Can't wait for the next video!

[@fiepps]

Someone just posted this on our piazza and I couldn't stop laughing. Can't wait to watch all the other videos!!

[@danieljohnson3024]

I really like the visualization. I hadn't been thinking of rotating the grids before.

[@NumentaTheory]

Another thing I did not mention was anchoring. You can change where the projections intersect with other projections. I hard coded them all to intersect at 0,0 but it could be anything.

[@winfriedwilcke1705]

Matt, this was wonderful!

[@NumentaTheory]

Hi Winfried, thanks for your comment, which I know Matt would've appreciated. Sadly, Matt passed away unexpectedly a few months ago. We miss him terribly. numenta.com/company/newsletter/2020/05/12/matt-taylor

[@lasaventurasdevitoelgatoma3405]

Superb, just superb... This is gonna be big someday... Jeff, Matt, all of Numenta keep it up! U may change the world someday!

[@MadnessRulesYeah]

Perfect explication. Very clear and dynamic. Thanks :)

[@JohnDemos-d7o]

I really enjoyed the excellent grid animations. Is that available anywhere to play around with?

[@williamwilkinson2748]

Great stuff, you guys have got it. I am convinced that from your work will come the machine intelligence that I dream of.

[@mdellertson]

Wow, amazing stuff! I'll definitely watch this video again.

[@chloeli2948]

Thank you for this incredible video. Made all the light bulbs light up!

[@WillowEpp]

Curious why you liken it to hexagons, not triangles? Also, why would the third dimension have a different form than the rest?

[@NumentaTheory]

hexagons are more fun

[@WillowEpp]

@@NumentaTheory Well, they _are_ a bunch of triangles having a party...

[@amandarojas5990]

This was fantastic!!!

[@mariusibanez7654]

amazing video as always, but I get one question : I see how this system work to represent location when you have already your position in the world, you can translate that position to the gird cell. but how does the cell do to know where it is in the world, and so fire. I can see that work by having a internal position in the brain that is update every time you move for example, but how does the mouse does to know where is position is when we put in in the box at first ?

[@NumentaTheory]

See paper “Computational models of grids cells” in video description

[@ZedBurnett-chophshiy]

Brains re-map whenever one enters a new space; Grids are (re)established by boundaries one senses or recalls.

[@dmlled]

simply, amazing

[@Stwinky]

Thank you form making this video holy moly

[@tinkrls3r]

this made my day

[@Michael-il8ls]

are distances same for human and mice, or are they proportional to their body weight?

[@PWNonCoD]

Amazing video

[@friedrichdergroe9664]

As always, excellent content. And the whole grid cell idea might have implications beyond the human brain. I won't say any more.

[@dkgaming9152]

Cells ko train kaise kre

[@111foreground]

Triangular lattice, triangular logo, triangulation in Euclidean space; all made possible by hexagons. LMAO!

[@juicyslew4653]

Is the demo used in this video available anywhere?

[@NumentaTheory]

discourse.numenta.org/t/how-to-run-htm-school-visualizations/2346

[@derstreber2]

@HTM School This is extremely interesting. Do we know what the mouse's knowledge of position (the grid cells firing) is based on? Like distance walked, sense of inertia, or the earths magnetic poles? So many questions... (some that probably matter some that don't, and no I don't expect an answer from you for these) does the position of the grid dots change with different iterations of the experiment? if so does it depend on where the mouse is placed in the room and in what orientation? if the grid does not vary when taking the mouse out, would two separate rooms placed side by side, that are not axis aligned, have a grid that mesh with each other or would the grid orient to the walls of the room? what happens when objects are added to the room? does the mouse grid ever drift, shift, rotate or recalculate over time? does grid cell fire for a sleeping mouse that is moved by someone else? do mice use an A* algorithm on a 3d hexgrid? (I could go on but I won't) Really cool stuff (If you know of where to find more information on these experiments a link would be great.)

[@NumentaTheory]

Hopefully you saw the papers I linked in the show description. That is where I got most of this info.

[@tonysouter8095]

So presumably one's "map" of a musical work is represented by an analog of grid cells. And perhaps the "internal clock" is related to the entrorhinal-hippocampal system too?

[@galshach]

is the demonstration tool you use starting from 2:25 available online?

[@NumentaTheory]

numenta.com/blog/2018/05/25/how-grid-cells-map-space/

[@superkhoy]

can you link the website you used for the visualization ?

[@NumentaTheory]

www.numenta.com/blog/2018/05/25/how-grid-cells-map-space/

[@superkhoy]

thanks, man great stuff. You should check out this 3d grid paper www.biorxiv.org/content/early/2018/03/14/282327

[@NumentaTheory]

Yes, i read that one too. :)

[@444haluk]

After 14 of these dad jokes openings, I kinda learned to appreciate it.

[@Tagraff]

Forgive me but I want to take a look at two separate scenarios: A) A mouse sits and it fires at any time upon sitting or resting. B) A mouse moves thoroughly (without rest or stop) and it fires at any time. What's the ratio for non-motion to motion? With open interpretation (combining three possibilities with each respective ratio): High non-motion to Low motion -- It needs to sit in its familiar place that is already registered -- so it doesn't need to learn its own place and has the time to think something else entirely - producing new information, accessing to non-related-memory-to-current-event-or-that-it-keeps-adding-attribution-to-current-event. Low non-motion to High motion -- When it's in the "comfort zone", it's already recorded all the previous-knowledge and there is nothing new to fire. But when it's moving around, all small attribution, details, motion, the gravity that throw the mouse off -- it constantly learning new information and if by some chance, some associative memory is familiarized or triggered, and it keeps adding new sequence whenever it trip, small something new, a change of shade...It doesn't consent to his usual rigid routine -- The nature or its reality keeps 'teaching' to the user of his existence.

[@NumentaTheory]

There are other cells in the brain called "speed cells" that respond to an animals speed.

[@jonbmia]

You all should get the Nobel prize!

[@addoul99]

Incredible

[@bobsmithy3103]

Very interesting. I wonder if there's been any implementation of that into AI systems.

[@NumentaTheory]

Lots of folks working on it!

[@DHorse]

This is where I really learned something new. About the brain and nn both. Awesome.... That was quick. The half life of comments.

[@AdityaSingh-hh2jr]

Fantastic :)

[@dragolov]

Bravo!

[@daviddavid7110]

Smartest stuff I've ever whitnessed

[@444haluk]

He just turned the dad jokes notch into 11 around 13:40 and they are actually no jokes, but the truth.

[@lasredchris]

Grid cells - deals with location in the brain Place cells Paper - evidence for grid cells in a human memory network

[@jabowery]

Excellent video. The 3D grid seems to naturally be tetrahedral rather than strictly orthogonal: A packing of spheres. This extends to hyperspaces as represented in Pascal's Triangle. Is there any way to test this experimentally? Has it been so tested? See Close packing of equal spheres: en.wikipedia.org/wiki/Close-packing_of_equal_spheres

[@NumentaTheory]

Haven’t tested it ourselves but that’s how I imagine it.

[@andrewm4894]

Looking snazzy today.

[@karinaburgess3989]

This guy is good…

[@tresorkoffi6435]

incredible explanation . RIP Matt You will be missing Numenta s team.

[@tblsaci]

Deep man. Oh wait

[@DHorse]

Information is expressed spacially by default for a few reasons. Reuse of course. But on deeper level concepts have a relational space. Or we think they do. Chicken or egg?

[@dkgaming9152]

Main raste bhul jata hu iska koi teatment hai

[@Ramdu]

I thought this was taking too long to come out because you were 'gridlocked'.

[@ghostdragonzero]

Where can I find the website where you show the demonstration with the mouse?

[@NumentaTheory]

numenta.com/blog/2018/05/25/how-grid-cells-map-space/