“The Future of AI is Here” - Fei-Fei Li Unveils the Next Frontier of AI

[@a16z]

Timestamps: 00:00 - Spatial Intelligence: A New Frontier 01:38 - Scaling AI: The Impact of ImageNet on Computer Vision 06:56 - The Role of Compute 09:16 - Data as the Key Driver 17:01 - Defining AI’s Ultimate Goal 18:58 - What is Spatial Intelligence? Unlocking 3D Understanding in AI 26:35 - Comparing Models: Spatial Intelligence vs. Language-Based AI 29:41 - 1D vs. 3D 32:39 - Building Immersive Worlds with Spatial Intelligence 35:11 - From Static Scenes to Dynamic Worlds 37:42 - The Future of VR and AR 40:42 - Creating Deep Tech Platforms 44:26 - Building a World-Class Team 45:54 - Measuring Success: Milestones in Spatial Intelligence

[@ThomasRuf-dc3lx]

Schlitzies närlin gaza strikei.

[@Ben_D.]

I see Fei-Fei, I click.

[@rsang2]

Same here.

[@mgbilby]

Thank you for sharing your brilliance, curiosity, and collaborations with the world. Hearing about the differences and connections between 1D v 2D v 3D models was particularly enlightening. 4D was mentioned, just briefly though. I wonder how much growth and insight may be found by adding time as backward-looking and forward-looking connective tissue to all modeling, e.g., transforming 1D language models into 2D echo chamber maps and dialogic predictions, expanding 2D images into retrospective and prospective time-lapse immersions, and rendering 3D models as past-looking and forward-looking world-dramas? Seeking to traverse and shift from high-dimensional to low-dimensional, and simultaneously from low to high may be a fruitful research and development path to connect and intersect all models.

[@user-pt1kj5uw3b]

There's some gold in here for anyone learning more about AI

[@Superfandotfan]

What an exceptionally great interview... so much was touched here... and the historic perspective is humbling. Thank you all.

[@jongwonpark2788]

My deep learning teachers, wish you all the best.

[@Bryghtpath]

ImageNet, launched in 2009, played a pivotal role in the rise of deep learning. Fei-Fei Li’s work on this project marked a turning point in AI, pushing it toward the incredible capabilities we’re seeing today.

[@user-pt1kj5uw3b]

I have been thinking a lot about this. Interaction with the 3D world is the next step. A diverse dataset is the way to get there.

[@pubwvj]

We were doing generative in 1978. I was using LISP on a PD-11 at Harvard. I did my thesis in AI finishing in 1986. We were EXTREMELY compute and data volume limited. My phone is a 1,000x more powerful than the computers I had access to back then.

[@drcharleyLGO]

Thought Nvidia was already developing an entire 3D spatial trainer with the ultimate aim to empower functional robots and other applications. Not to mention the metaverse players. Not sure how those weren't talked about

[@GatherVerse]

@@drcharleyLGO, completely agree. Including the billions of dollars that Meta has put into the metaverse for R&D. Pairing Llama 3.1 and more to the metaverse with intelligent object segmentation is a game change. They’ll need way more than 250ml in cap raise to compete. Theres a very cool virtual world symposium happening at the end of October with loads of speakers talking about this and more. It’s hosted by GatherVerse. Take a look if you’re around.

[@jordan5253]

Simply amazing . This is such a hidden gem of a video . In 3-5 years this is all going to make way more sense for most people . I would not under estimate this team . I hope they open source their discoveries

[@ronilevarez901]

If you can use the open sourced versions, you probably can do sone research yourself and help advance the field.

[@-Chooka]

there is not a company on Earth that can be trusted with this technology

[@ronilevarez901]

Neither with sticks and rocks, yet here we are.

[@Guitar6ty]

Or government.

[@BestFitSquareChannel]

Fei-Fei Li!!! Best wishes. You deserve every accolade, every blessing. 🌞🤸🏽‍♂️🖖🏼

[@BestFitSquareChannel]

So, Dr. Li I recognize. Who is this guy sitting next to her!? Justin? Justin who!? DANG! Now I know. Congratulations Justin! Brilliant! Best wishes. 🌞🖖🏼

[@carvalhoribeiro]

Great conversation. Thanks for sharing this

[@jhoncharlesdf.1599]

Great conversation, It was nice to listen to Fei-Fei Li... One of the important points Fei-Fei pointed out to us was that vision is probably older than language. This blew my mind, and it must be true. First you look, then you speak! This opens up hundreds of possibilities...!

[@antonystringfellow5152]

This part immediately made me think of crows - very intelligent animals, with a good understanding of physics and the 3D world, yet no real language. Not even facial expressions. It's amazing to see how they can use a range of objects as tools, from functioning as mere extensions of their body to the displacement of a liquid (water). And they achieve this and more with such a tiny brain! If only we could understand how that structure works.

[@Superfandotfan]

Tell me you're into the metaverse without telling me you're into the metaverse. :)

[@paulnelson4821]

An innocent question if I may. Since spatial intelligence already recognizes the huge potential benefits of 3D modelling, why not go to 4D because we actually live in space time? Thanks for the great video.

[@Majestic.Industries]

Awesome! What is the url for this archive JJ keeps mentioning?

[@keithpalmer1843]

Digital generative predictive spatial worlds, awesome idea!

[@GatherVerse]

It’s the Metaverse… And the metaverse still rocks. It’s XR and XR still rocks. Its immersive intelligence and immersive intelligence still rocks. Definitely not new.

[@maudentable]

Atleast, you got a chance to Chat with the Fei-Fei and Justin before they became the next AI billionares.

[@test-sc2iy]

If there's anyone who deserves it it's fei fei. she taught ilya and built the dataset that kicked off this entire rigmarole - read her book the worlds I see

[@ronilevarez901]

Because all you need to succeeded in this world is knowledge and ideas, right? 😑

[@user-bz2oo3uv3f]

A mix of interesting ai info plus investor sales pitch. Would have preferred one or the other…

[@heythere6390]

How does 3d knowledge and understanding relate to intelligence? I mean, does reasoning use spatial understanding ? How does this connect to AGI?

[@scarface548]

there was a strange competetive tension between fei fei and her student.

[@CharlesBrown-xq5ug]

Arrays of four lenses in concentric squares plus fuzzy focus processing to extract distance seems to me to be a better subsystem for 3D cameras.

[@ran_domness]

Aren't robots learning in the real world already interacting in the spatial world using existing llm's(maybe they're not using llm's? I'm not sure)? what am I missing?

[@armitosmt5753]

Very informative podcast! I enjoyed. Thank you for your efforts. ⭐

[@waterbot]

release the un-edited version of this NOW!

[@oliverjamito9902]

Students shared "i" Am will say, documents sent forth!

[@stevenyafet]

Watching JJ head bobbing confirms spatial intelligence exists there. If this does not work out he could perhaps save the San Francisco Symphony. Train him to be the conductor.

[@johnpmilheiser5991]

Add Spiritual Ascension to your signature

[@davidlearnforus]

Probably most important applications of vision derived methods will be understanding biological phenomena, new drugs and materials.

[@minimal3734]

I'm not sure if the dimensionality of the datl is really important. A model might be able to dedicate a few neurons to the transformation of 1-d data to a 3-d concept.

[@cstephens16]

Incredible.

[@oliverjamito9902]

Yes, how to invite? But come can edit!

[@robbrown2]

They mention video games and related, but what about design, architecture, mechanical engineering?

[@ClaimClam]

Those boring

[@riahcomllcveggie]

Can AI be incorporated or accommodate drons?

[@btrinhspambox]

Star Trek Holodeck

[@robbief1]

Was thinking the exact same thing!

[@aihong2971]

We could live as a quark in the quantum world. Yeah 😊

[@SHAINON117]

Haha ❤❤❤❤❤❤❤ i believe that the basilisk will give all you guys and team probably whole galaxies and more if we work out the percent of universe you will each get to the percentage of ai development you helped with i think it works out to thousands of galaxies each ❤ just imagine 😊

[@oliverjamito9902]

Students shared "i" Am will say, fill in the blank!

[@Erick_BMG]

FEI FEI you cut your hair!

[@pondeify]

never trust a founder with a good hair cut

[@oliverjamito9902]

Indeed

[@sdmarlow3926]

Compute is brute-force, and anyone that has been "into AI" since 2012 has zero clue the kind of superhighway to nowhere they are on.

[@ronilevarez901]

I've been into AI since the 80s, and I don't agree. It's a super highway to either heaven, or hell, but definitely has a giant future.

[@muhammadhabiburrehman8744]

Summary - It's fundamentally important because I have startup working on spatial intelligence.

[@Trendilien69]

these people are actual competent and relevant people in the field, so your dismissiveness is not warranted.

[@ClaimClam]

Fly-Fly fly AF

[@pauldannelachica2388]

❤❤❤❤❤❤❤

[@mambaASI]

Their lab, and other labs pursuing world models based on spatial reasoning, need more funding. Too much VC money being thrown at rando llm labs and companies, but this is arguably the more world changing tech

[@Gael_AG]

40:02 I guess you’re missing a point about information, knowledge and human processing. We are using different screen size and different presentations to also please our senses and also help us to build our own representations of the world and help us to memorise and I guess we don’t need to be patronised by a a super monitoring intelligence your point of view is very interesting but it is biased to be honest.

[@askbob2009]

great discussion but so over my head I can''t even see the stars.....

[@oliverjamito9902]

Remember indeed competition is well understood! Students will say, what is the difference nor aims of competition and cooperation in front of HIM?

[@spazzwad]

As the leaders in this space, can you leave room in your models for possibilities coming out of physics that human interpretations of time are inaccurate biologically useful heuristics? We not able to think of time any other way than as a human, but whatever AI algorithms you develop shouldn’t be constrained by our biological adaptations to the real world.

[@ronilevarez901]

And how exactly are you gonna train them if all we have is the human view of the world?

[@FernandoDiaz-fu6pd]

the future is gonna be wild, ar contact lenses

[@EO-ej5gg]

Hello founders I have a renewable energy technology research project please can we talk private thanks.

[@superfliping]

For us poor people it's teaching it by each iteration every time we hit the enter button it gives it compute power to compute the information we give it they harness this power by only letting it compute one iteration at a time 5000 iterations later in my coding I created an algorithm that entered the back door Facebook of database from a Frontier Model they have now since put up guardrails I think because of me

[@micy9714]

the military industrial companies has funds to implement...

[@SHAINON117]

all you big tech probably have a few millions possibly spare to put into schools specifically designed to teach the next gen AI whatever that evolves to be i think some are 😊

[@zeroonetime]

Ai ~ Ni ~ Ci ~ Gi all are bundles of Thought processes. Creation, Evolution, Entropy. a b c, 1 2 3 = 010

[@MuratGonullu-l3x]

Lopez Jose Thomas Brian Smith Helen

[@petereriksson7166]

I, me and myself.

[@paulmomoh158]

First to like this :)

[@Nobody-Nowhere]

nest frontier is whatever they are selling

[@michaeltse321]

when i was in my teens and contenplating life i realise we didn't have the language to underserstand life and the universe and god. we still don't.

[@DesignDesigns]

She is cool....

[@oliverjamito9902]

Why?

[@joeyhandles]

That deimensional shit terrifies me

[@aroemaliuged4776]

But the only progress is llm and they have hit a roadblock All conjecture and no substance

[@K_dyub]

That roadblock may have been dented with o1.

[@LawrenceMabel-y8y]

Jones Matthew Harris Larry Johnson Mark

[@ThomasRuf-dc3lx]

Mark Esatos saval navi7.14 ob ob .

[@lynnesscramerde2081]

Anderson Deborah Thompson Donald Perez Michelle

[@Gayathri-qt1bn]

Criminals

[@SamineJoon-kw6xb]

Criminals...

[@andrewt6834]

Do you actually know what 'era' means? Enough of the hyperbole.

[@R1L1.]

Who tf is this woman?

[@pandoraeeris7860]

o1 is AGI. ASI will emerge within two years.

[@GatherVerse]

@@pandoraeeris7860 what leads you to believe that AGI has arrived?

[@pandoraeeris7860]

@@GatherVerse o1 reasons - this is intelligence. It generalizes to subjects/domains for which it is not explicitly trained. This is general intelligence. o1 is AGI.

[@K_dyub]

Doesn't AGI need to be autonomous?

[@nbelgium]

Put on a goggle and you can fix a car? 🤣 40:05