What is information theory? | Journey into information theory | Computer Science | Khan Academy

[@xOTSx918x]

Hello everyone, just here to say I stumbled to a side of KZbin that is blowing my mind right now

[@Terminalco]

Let your mind grow Don't let it stop expanding

[@topdog5252]

It’s amazing

[@matteopalama1]

Same here

[@rontorres9547]

Elon musk had an interest in information. So I thought.... Maybe I should too... Thanks for your comments

[@DeadBadger223]

String theory?

[@dejanbogosavljev9381]

I must say that this is the best intro to a topic I have ever heard, it did it's task, to make me curious about the topic and willing to learn, perfectly. I don't know what exactly caught me, but there's something special in this particular combination of words, pronunciations and sounds.

[@ArtOfTheProblem]

Dejan Bogosavljev awesome I hope you enjoy the rest of the series let me know how it goes

[@dejanbogosavljev9381]

Just finished it, what a ride. Thanks for posing all of this!

[@britcruise2629]

+Dejan Bogosavljev Good news. Episode three is happening! Stay tuned.

[@jebelin50]

0

[@madangupta2335]

Good morning my all Facebook friends

[@Z4RQUON]

In physics, information is "the distinction between things".

[@Ray2311us]

In chemistry its the relation between things.

[@terryzuniga2473]

Love all the shots and image resources used in this video

[@LiLiKOiOiOi]

This is actually awesome

[@aryamahima3]

Gosh ...that tearing apart of page from the book hurts...

[@silvioapires]

I felt exactly the same!!!

[@worldnotworld]

I felt the same too; in fact every object was aggressively manhandled.

[@dr.alaaal-ibadi8644]

I like this channel. I'm already teaching this topic for student in Iraq.

[@jimparsons6803]

One my favorite topics!! Explains much.

[@iTechX_Repairs]

This is explains why Information Literacy is so important to any Great Scholar 💯

[@skreutzer]

2:22 based on 2:42 is simply not true. "Information" refers to the length, complexity and meaning of the message, while bits are just one unit among many others for transmitting/encoding state changes. For information, it's not valid that its encoding is necessarily binary, and if so, to encode/express an information message in a binary format/medium, the amount of bits needed can explode, because in reality, information is hardly emitted by an exclusively binary source without any context, so encoding/translating/converting such messages into the artificial binary encoding scheme increases the amount of bits needed in order to represent the message loss-lessly, preserving its informational meaning.

[@AmartyaDattaGupta]

Excellent introduction for someone with no idea about the subject. But did u really have to tear the book :) ?

[@elir7184]

Say we take the bit as the most fundamental unit of measurement for the book in question in this video, and measure its bits. But then we rearrange the sentences of this book to be as informationally compact and direct as possible while still maintaining the original meaning: he rearranged book is now composed of less bits, although the total meaning of the first book and the rearranged book is still the same. Does this insinuate that the number of bits is somewhat arbitrary when measured to meaning itself?

[@pedrovelazquez138]

this intro is gold

[@felipe1055]

This video/topic freaks me out

[@juhokupiainen5515]

How many bits? Have fun answering the question with me? (I think research is fun.) How many bits in a hard disk? How many bits in the human mind? How any bits in the universe? If you would like to have a session of pondering about these questions by having a conversation and researching the web, contact me.

[@alicecree6567]

Omg I have an idea yayyy

[@HL-iw1du]

Thinking of reality as information relies on the fallacy that all ideas are on the same level of abstraction. For example, saying that an almost perfectly defined, not very abstract concept, like a specific chair, is on the same level of abstraction as a very loosely defined, very abstract concept, like pride, is fallacious. This is why computers still cannot think as critically and as creatively as humans do. Artificial intelligence relies on the false assumption that all concepts are perfectly defined and at the same level of abstraction. This presumed single level of abstraction is called “information”. For everything to be on the same level of abstraction, one could only look at the Universe at the infinitesimal level. Here, the level of abstraction is zero. It’s the most fundamental level of reality. But of course that would be computationally impossible, as well as nonsensical because at the infinitesimal level, there are no such things as observers, like humans or computers.

[@ankitaaarya]

Deep logical thought provoking

[@sfcs3743]

To me, reality is only a concept that affects the observer. Assume a world with no observers, would such a world physically exist? If so, how do you prove it without being able to prove that it exists, or existed in the first place. Computer's are not abstract, they don't rely on any abstraction as they are physical machines, if we are not talking about automata. How we manipulate the machine to create systems rely on abstract principles like "information" as they can be more productively put into use that way rather than thinking and tracking each electron and their energy. And if by AI, you are referring to artificial neural networks, they rely upon statistical regression to "predict" a pattern to a given set of input based on algorithms like backpropagation. While computer's still cannot think anything abstract like humans to be critical or creative in the same sense as humans, they have a lot other uses if you haven't noticed. People used their creativity to come up with a solution to connect each other wherever they are situated, and they came up with transistors to revolutionize information processing. So who is to say that humans would fail to make computers compute reality far better than humans, with or without the creativity and critically like us? (

[@thevoicestoldmetoagain4627]

I didnt know this was a legit theory in science. I was just telling someone the other day how all anything is in the universe is just data. Everything in existence is just a compilation of data. Everything. Weird concept but thats reality.

[@chicku975]

Intriguing

[@evynt9512]

Computational Irreducibility and Computational Equivalence is more important than Information Theory.

[@andres-vi1uy]

what's the song being played on the piano?

[@Galakyllz]

Measuring information by its entropy is like measuring two points on the globe by how far away they are from the equator. Sure, they can be compared, but they aren't actually being directly compared to each other. This is what's always bothered me about this kind of metric for information.

[@brendawilliams8062]

Yes, me too. Density put in a leash between 5 and 5.

[@noneedname4]

Traduit en toute les langues sauf le français, nikel 👌

[@camilserapian7675]

Can you encrypt odors ?

[@camilserapian7675]

nope

[@camilserapian7675]

but not scents

[@dylanschellenberg8617]

@@camilserapian7675 lol

[@Sokofeather]

The composition of a compound is an entirely different thing from the sensation which it elicits from a nervous system with consciousness. That's the fun part

[@camilserapian7675]

@@Sokofeather So you'll realize that you are encrypting a chemical molecule atom by atom .

[@aSeaofTroubles]

Where is the full series?

[@madangupta2335]

Madan gupta from jammu kashmir state jammu tawi india

[@chrishilliard6140]

Studying elon musk and he got me in a rabbit hole

[@cynthiamandal1091]

can you tell me the differnce between 'information science' and information theory' with suitable examples?

[@Kirtymonma]

cynthia mandal info theory is the scale, info science is you giving me your phone numbwr

[@GabrielMesquita-mz4um]

Information science is a field that focuses on how information is organized, processed, and used effectively. It deals with the study of information systems, information management, and the practical applications of information in various domains. Information scientists explore ways to collect, store, retrieve, and analyze information to support decision-making, knowledge sharing, and problem-solving. Example: Imagine you're working in a library, and you want to make it easier for people to find books. An information scientist would study how books are organized, create classification systems, design user-friendly catalogs or databases, and develop efficient search algorithms to help people locate the books they need. Information theory, on the other hand, is a mathematical and theoretical discipline that focuses on quantifying and measuring information. It explores fundamental concepts such as data compression, coding, transmission, and the limits of information transfer. Information theory provides a framework for understanding how information can be efficiently transmitted and processed, regardless of the specific content or meaning of the information. Example: Think about sending a text message to a friend. Information theory is concerned with how to transmit that message efficiently and accurately. It deals with questions like: How much information can be transmitted over a limited bandwidth? How can we compress the message to save storage space or reduce transmission time? Information theorists develop mathematical models and algorithms to optimize the transmission and processing of information in various communication systems. In summary, information science focuses on the practical aspects of organizing and utilizing information, while information theory deals with the mathematical principles behind how information is quantified, transmitted, and processed efficiently.

[@Christian_Prepper]

*INFORMATION THEORY ESTABLISHES a MIND is ALWAYS the ORIGIN of INFORMATION, SO DNA CODED INFORMATION COMES FROM...*

[@koskism9181]

I hate how surreal this video is

[@dutdut11]

Shout out CpE 3A

[@Persian_Rug_Merchant]

Whoah hold on can any information be stored in bits? Isn't that true only if it's digitized? Human memorizes aren't stored in bits AFAIK.

[@Ray2311us]

Neo from the matrix loading right now.

[@dylanhume1093]

“The bit a unit of surprise” what?

[@MauricioMartinez0707]

Watch this video high as fuck just trust me

[@sportdutch]

What does the " cave " have to do with it? Plenty of animals have learned to communicate without a cave.

[@abdulazizhawsah9884]

Visuals are destructive.

[@douglasstrother6584]

"Too Much Information!" ~ The Police

[@xqxxy686]

I believe everyone who has ever done shrooms is aware of this info. Or is that just me?

[@chandra_creator]

anyone who's been manic too

[@alicecree6567]

Also anyone here from computer class

[@maxcl3474]

Me

[@chrishilliard6140]

No way people here past 2022

[@zes3813]

wrr

[@MOGE_]

Why did you say "we return to the cave"? Is that some sort of refrence i don't get or what

[@bmoneybby]

Possibly Plato's cave allegory idk.

[@enderboy6491]

💤

[@neoaureus]

Creepy fucking beginning ….Alice is a zombie?

[@exitparadise2244]

In the Christian bible, this paradox/conundrum is referred to as the Tower of Babel ...

[@grahmedmisen2195]

Yeah, I would think so. Cant find our satisfaction in information but it is the way yo go about life right?

[@rajnishyadav4296]

Elon 💖

[@camilserapian7675]

fElon

[@zes7215]

no such thing as dna or not or powerx excix etc about it

[@JavierLivasCantu]

Again, a wrong definition of what "amount of information" is. "A bit is linked to a very simple idea, the answer to a YES or NO question.Think of it as the language of coins." That YES OR NO question is assuming that the yes and no correct answers refer to one of two events which are exactly equally probable. IF you do not explain the PROBABILITY then your definition is TOTALLY incorrect and confusing. Too bad it has so many views.

[@maniklalbanerjee67]

I

[@maniklalbanerjee67]

Javier Livia's Cantu

[@maniklalbanerjee67]

.

[@skreutzer]

Furthermore, the "yes" and "no" binary informational encoding makes in itself no statement about coins or letters or hyroglyphs, therefore this particular type of information limited to yes/no without any context or meaning doesn't say anything about probabilities or amounts of "information" other than what's needed by the binary medium for information encoding, regardless, separate and not related to the actual information that's lined up for transmission.

[@zes3813]

wrg

[@Christian_Prepper]

*CHILDISH ATHEISM?* *One small child says to another, "I think cellphones grow on trees."* *The other child responds, "I think someone makes them."* *The first child then replies, "Nah, until I can figure out how to make one on my own I won't believe anyone else can make cellphones."*

[@ihmejakki2731]

CHILDISH THEISM? One small child says to another, "I think cellphones are created by God." The other says, "I think regular people create them." The first child then replies, "Nah, because I can't figure out how to create one on my own they must be created by God."

[@Christian_Prepper]

@@ihmejakki2731 *I guess you failed to understand the video. Information theory is a well-established theorem that is easily analogous to the information discovered in the genetic code of DNA.* *So the point of my illustration is that the first child is basing his expectation on what is observable, provable. Whereas the second child is not.* *Hence, any hypothesis that the information encoded in DNA somehow came into existence by undirected random chance is, well shall we say, bullocks! And resembles the naïve mind of a child (or smells like the deceptive practitioners of blind faith found among the dumb masses clinging to world religious institutions & organizations).*

[@jimblane1183]

Thanks for wasting my time.

[@hosoiarchives4858]

So poorly done