Intelligence is more than compression | François Chollet and Lex Fridman

Full episode with François Chollet (Aug 2020): • François Chollet: Meas...
Clips channel (Lex Clips): / lexclips
Main channel (Lex Fridman): / lexfridman
(more links below)
Podcast full episodes playlist:
• Lex Fridman Podcast
Podcasts clips playlist:
• Lex Fridman Podcast Clips
Podcast website:
lexfridman.com/ai
Podcast on Apple Podcasts (iTunes):
apple.co/2lwqZIr
Podcast on Spotify:
spoti.fi/2nEwCF8
Podcast RSS:
lexfridman.com/category/ai/feed/
François Chollet is an AI researcher at Google and creator of Keras.
Subscribe to this KZbin channel or connect on:
- Twitter: / lexfridman
- LinkedIn: / lexfridman
- Facebook: / lexfridman
- Instagram: / lexfridman
- Medium: / lexfridman
- Support on Patreon: / lexfridman

[@jggerald7877]

"Intelligence is compression" only means that it is smart to fully describe or output the true information of the finite data source (or file) in the smallest possible number of bits. This is called entropy or also called popularly as Shannon Entropy. "Minimum description length" to others. If you can achieve it, you're very intelligent so to say.

[@vincebartle]

Isn't exploration a compressed feature itself though. Also doesn't exploration itself carry compression: i.e. what exploration model do you use and how is it determined? He's saying intelligence = compression + exploration; but he doesn't explain how exploration is strictly exclusive of compression and thus a necessary addition to the definition of intelligence. It seems he's trying to expose how compression can be an over-deterministic model, which doesn't seem true, it's just that ineffective compression can have over-determination as a trait. It might be better to say that lossless compression requires some exploration as a feature.

[@MrJorgeceja123]

schmidhuber pilled

[@JMS1089]

3:32 true, but information is structured to "make" it appear important. at least that's how it feels when you read.

[@sweettea4296]

🖤

[@tubbybrown1918]

wb lossless

[@telesniper2]

Algorithmic based compression is useless in context based knowledge systems.