Checksums and Hamming distance

[@ronjones4069]

You gave the best explanation of error detecting that I have ever seen, and I've spent 50 years in the business. Where have you been all my life????

[@Tikorous]

It took him that long to carefully cut and place all those wires

[@parallellinesmeetatinfinity]

@@Tikorous 💀💀💀

[@baileyharrison1030]

I like how you say ‘in the last video’ like it wasn’t 7 months ago.

[@BenEater]

Heh.. yeah... well... I'm playing the long game. My hope is that the vast majority of people who watch these videos have never heard of the channel yet. No need to apologize to them, right? :)

[@nikolaimikuszeit3204]

Not sure if that " ...have never heard of the channel yet..." worked a planned.

[@sethhawkins3507]

@@nikolaimikuszeit3204 lol probably not but I'm glad he's back making vids!

[@jillkitten5388]

Yeah, I anticipate the vid on CRC, hopefully it doesn't take many months for it to come out.

[@sheaton319]

@@BenEater I just found your videos on building an 8 bit computer and I am buying parts on ebay as I type, so don't sweat it.

[@azyfloof]

So if my parrot starts squawking "Pieces of nine! Pieces of nine!", I know that's a parroty error. Got it :)

[@-X3R0]

I hate you but I love you.

[@azyfloof]

@@-X3R0 I'll take that! 😁😁

[@ohasis8331]

Cute

[@koshyalex8009]

good to see ben come back with an update

[@Roxor128]

Fun little thing not covered in the video: The 2D Parity scheme isn't just capable of detecting more errors than the simpler schemes, but it can also be used for error correction. If both a row and column show a parity error, you know where the error occurred and can flip that bit to correct it. That gives you a code capable of correcting one error and detecting up to three.

[@gabrielveloso1325]

I think the problem with this, is that we can't distinct if there are three wrong bits or just one. If we try to correct the single bit we know that is wrong, and use the message, maybe there is actually three wrong bits and the message will pass with errors in there

[@Roxor128]

@@gabrielveloso1325 It's more a case of if you haven't exceeded the correctable number, then you output the corrected block, and if there are more than that you just say "uncorrectable errors found". Multidimensional parity is a distinct algorithm that builds on traditional parity checks (as do a lot of others, like Hamming Codes). For N dimensions, you can correct N/2 errors and detect N+1, so a 4D version could correct two and detect five, but it would need a lot of parity bits to do so.

[@jamesdavis2027]

These videos are always worth the wait!

[@hgbugalou]

I knew how checksums worked on a high level but actually seeing the math in detail is blowing my mind a little! Very cool.

[@terryo4352]

I always knew a value was assigned to both groups of data and them the two are compared, but i've always wanted to know exactly how it works. While this video might not explain complex versions like MD5 or xxHash or stuff I use professionally, it still showed me soooo much! Plus I would NEVER understand the more complex ones anyway XD

[@ShaileshDagar]

You're back on my birthday. What an awesome gift!

[@BenEater]

Happy birthday!

[@dsi-films1264]

: DDD

[@enjibkk6850]

I really love this approach... building things from the ground up, with a 'naive' approach first, highlighting the issues and improving. Just like my curious schoolboy self of old, I find myself thinking 'but wait, what if.... ' and there Ben answers the question.

[@hagbardceline9866]

oH well,lord!

[@gavin5410]

Looks good to me

[@drgothmania]

I'm just an amateur Python/C# user and accidentally saw your video about C and Assembly. You explained everything so simply that I understood completely easily. Thank you very much. Please make more videos like these - they're worth being shown in tech uni.

[@kamilkoczurek484]

Great video, Ben! Now I’ll spend next half a year waiting for the sequel. :’)

[@gloverelaxis]

I can't get over how incredibly elegant that simple checksum turns out to be!

[@audeophilic2578]

This is seriously one of the greatest CSE channels I have ever had the pleasure of watching. I've watched all the videos leading up to this in the series so far, and I have to say that coming into it I didn't expect to have a supplement to my education, but you are incredibly clear and probably one of the most effective teachers I've ever seen on KZbin. Thank you.

[@terryo4352]

Watching him work with analog (?) computing like this was truly amazing for me. I'm no coder or engineer or mathematician, but I work with computers and data and video every day. Watching him just map pins and run power to make things come to life was almost as eye opening as realizing South America fits into Africa like a puzzle piece. I always knew what computers do (on a surface level) but to see them built in such a mechanical and simple way really made me see the whole picture for the first time.

[@CMBoydon]

Its a shame that the best teachers are so often found outside the education system

[@nkos6376]

youtube is the new education system. better than any school out there :)

[@drewduncan5774]

It's a shame that the education system pays/treats teachers so badly.

[@Uberazza]

And always told by other teachers that they will never amount to anything whilst during their time at school.

[@chawkijeder7850]

They are the best teachers simply because they are outside the education system .

[@aion2177]

it's survivorship bias. We can't get an Albert Einstein in every little village. We define a genius as something very rare. Is all about how we define it. Every little village has a human, and every human is a genius compared to the best AI systems we currently have, assuming intelligence is on a continuum. It's all relative to what you define as common and compare against. As such you can't escape this law no matter the level you work on. And this means places like KZbin - a system which somehow can act as a global education platform, will always condense the best teachers in this case. Your underlining assumption is that KZbin and online learning is not the best way to do learning - that somehow the traditional way is the way to go and we should improve on that. Which is actually wrong for most subjects which we generally consider that "they belong in school". The traditional education system is already reached the local maximum - it can't get 10x-100x better no matter what you do - and that is basically a similar situation like the ICE cars vs electric cars. For the simple fact that they have less complexity, electric cars should be pushed instead - no matter of pollution or global warming or resources or anything. Just design complexity alone must be the key decision criteria in driving out ICE cars.. So similarly the shame is not that we need more resources for our universities and we don't do that or whatever im reading in this comments above. The shame is that this traditional education system is already a dead end, and is not realized as such, and all those resources and effort and everything will be wasted investment compared to just pouring that into the online space and thinking seriously how to incentivize that - how to build a real working solution for educating everybody in the world. Because KZbin is not it. KZbin is a placeholder since there isn't something better available. Specifically on the question of "how to build the education platform", i'm assembled a list of great teachers over years, and Ben Eater is definitely on it. But the fundamental problem of why this is happening in general is far deeper then just this education context, it's about incentives, about economy, about value systems, about understanding, about truth, about how our mind works, about how we differ from each other, about what we want and should want - because we are explicitly or implicitly programming what people want and how they live lives, etc, etc - its a highly interconnected mess and "education" can't be fixed independently. We don't understand enough about it yet. It's a rely hard problem. This is why was not solved already despite the best minds constantly thinking about it. We gonna need more time to understand it in this holistic sense because any other attempt is gonna produce more of the same crap, we gonna still leave good teachers out, and comments with many likes like yours gonna still be a thing in 50 years - acknowledging the problem - basically that's how we know we did not solve it yet :)

[@jiwan88]

you are doing very cool things. Keep rocking !!!

[@davidpyper1688]

Excellent Video!!! Myself and 193,000+ people are glad to see you back on KZbin.

[@ProXicT]

You, sir, have an amazing gift. You explain fairly complex topics with such ease, so it is very easily understandable. Truly unique teaching skills!

[@classyjohn1923]

the idea of how checksum works is so genius. We're basically encoding the decimal values into our carry-over bits.

[@zodak9999b]

Thanks, Ben! That was very interesting and informative. I'm definitely looking forward to the CRC explanation.

[@carnright]

Love the clarity of how you present the concept! Also love the sliding paper to give more information quickly 😁

[@NotMarkKnopfler]

New video from Ben! Yeeeees! Where have you been, Ben? Great to see you posting videos again.

[@terryo4352]

I've been downloading and managing data on video sets for almost ten years now. I like to think I'm close to transferring a PB in my career (with only a couple failures due to drives). I've used ShotPut Pro for years and Hedge as well, knowing roughly what checksums were, at least enough to half-ass-edly explain it to producers to show them my day rate is worth it. This video series has what I've been kinda looking for for YEARS. I always knew data transfer rates, R/W speeds, etc. But math and coding is all beyond me. Still, I always wanted to know how these processes work to the granular level and just how the data is transferred and monitored. Thank you so much for this series Ben! YT recommended the Video Card video and I found this series! Love it!

[@Misterlikeseverythin]

This is the entirety of one of my networking courses in Uni, done in a few hours, more clearly and interestingly.

[@superdau]

There are videos that end and I think "why was that so short? I want to know the other stuff now!". Then I look down and see that I already watched half an hour without even thinking about skipping a second. Those videos are rare, but this is one of them!

[@jamesfurrer2924]

This was so much better than my Comms course. Seeing an actual use case makes it all really come together.

[@melihcelik9797]

I think I love this channel. Even tho I know these things basically but seeing them work on a hardware level is different. I never calculated a parity bit by a literal flip-flop before. Seeing these bytes and bits in action is really interesting. Great content. Subbed

[@mikafoxx2717]

I can't wait for the CRC episode! You explain things in a very easy to understand way, even when it's low level. I would love if you could go into forward error correction in the future as that's one thing I've had a lot of trouble grasping.. I know it's complicated maths, but at least knowing how it's implemented would help tons

[@551moley]

Thanks for your videos, I would say I'm mechanically minded and I have no problem working out how things work, but I've never got to grips with how electronic components and data transmission works. Thanks to your videos you have filled in many of the gaps and helped demystify it.

[@alphasatari]

Finally, Someone realised he also has a KZbin channel.

[@crummmycheese]

He might be into 100 things.. KZbin is not life

[@hemerythrin]

Fantastic video, really excited for the next episode! Keep up the good work!

[@fenylmecc6347]

my best teacher is back.

[@mikewilliams564]

Best videos on KZbin. Always worth the wait.

[@AmeanAbdelfattah]

YOU'RE ALIVE!!!!!

[@SimpleLangSolution]

This is just like Breaking Bad. Once you start watching the first episode, you immediately get teleported to next week. Because all you did was binge-watch the whole thing with all that juicy cliffhangers at the end. Also that it's like blue crystal. It's tight!

[@shahabbangash5499]

1 day without your videos i am almost dead inside... Love your work

[@ahndeux]

I had insomnia and couldn't sleep today. This video cured my disorder!

[@casamar3393]

Glad to see you come back in the channel, your videos helped me a lot Thanks

[@1997CWR]

To anyone wondering what the books are at ~ 18:00: The first book is "Mindstorms: Children, Computers, and Powerful Ideas" by Seymour Papert (1980) and the second one is "Flatland: A Romance of Many Dimensions" by Edwin A. Abbott (1884)

[@lelandclayton5462]

One of my favorite KZbin professors.

[@PiercingSight]

Your channel gives me great happiness.

[@plkap74]

Love that the books on your desk are Mindstorms and Flatland

[@karanpatel1419]

You are the old tony of computer world

[@anandsuralkar2947]

I am fascinated those computer scientists are very cool and talented

[@dillon4321]

Your videos are awesome man. You are clearly very passionate and knowledgeable

[@jorickcaberio1865]

finally a new upload! 👍

[@allanrichardson3135]

7-track tape (when characters were 6 bits) and 9-track (when they became 8 bits) used BOTH techniques: the 7th or 9th bit in each character of a tape record was parity checking for that character, and an additional character was added at the end, with each bit tracking a column’s (R/W head) parity. Any single bit error could be corrected, and any double bit error, and many multiple bit errors, could be detected but not corrected.

[@drgr33nUK]

Welcome back Ben! Awesome video!

[@fleshTH]

Welcome back! Good video. Can't wait for the next. I'll probably have to watch this one again when I'm more wake though.

[@Wambotrot]

Yay! Finally! Great video. When you started this series I was hoping you would do one on CRC's. Looking forward to it!

[@cigmorfil4101]

In the good old days of serial communications (at 300, 1200, 2400, 4800 baud) the parity bit was the top bit of the byte - that is why ASCII was originally a 7 bit code.

[@mehdisalehiheydarabadstude6519]

Yaaaaaay. Im more excited than the new season of GOT.

[@Artaxerxes.]

Off topic but since GOT was garbage, this video was bound to be more exciting than it

[@mehdisalehiheydarabadstude6519]

@@Artaxerxes. Yeah I cheated a little bit :)

[@kaitlyn__L]

That’s also why CDs used 14 signal bits to encode each data byte, to have a very large error correction and recovery limit. And indeed spacecraft like the Voyager probes have something like a dozen parity bits for every data bit - the delay means retransmission can’t be requested, so recoverability is prioritised over speed.

[@brianevans4]

Your videos are so amazing! Really well researched, yet exlained in a way that anyone can understand. It must take so long to do all the preparation for a video like this. Thanks Ben!

[@olarmariusalex]

You are a mine of gold! Thanks for your video's and for your great education work!

[@baap2499]

Damn after so many months.

[@augurelite]

I love your videos sooo much I always learn a ton and your explanations are very clear and easy to follow. Once I start my job this summer I'm going to be a Patreon supporter of yours!

[@taberbooth9203]

You’re a wizard, Harry.

[@lalchandra4590]

I really need this kind of videos. Interesting, all major things covered in this video. 👍👍👍

[@randomviewer896]

I'm glad to see you're back!

[@montpierce424]

Love your videos!! Do you mention anywhere how would you handle bit-alignment errors? Try starting the Receiver at a random pause after starting the transmitter? Bits could all be received perfectly, but if the bits are misaligned, the data would be wrong.

[@techtronimbus8058]

I had been waiting for this video for very long time .

[@tf3confirmedbuthv54]

The man himself!!! He’s back!!!

[@ulysses_grant]

Good to see you back man!!!

[@iluvpwny7565]

afther 7 months, you finally upload a vid!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!! . . . . . this surprised me so much, I thought you will never come back

[@NouvelEmpire]

i love you serie, i would prefer to discover it already done so i don't have to wait for the next episode

[@mandisaplaylist]

24:18 You could save the time explaining how the 3 bit errors mess up the rows and columns by realizing that any 3-bit error will mess up the overall parity bit. You need an even number of errors to keep that bit happy.

[@bapple7844]

Not sure if you know this but you're the best

[@sayandutta0310]

Its good to c u back...

[@RoBBz2000]

Ben, you are an excellent teacher! I just watched all the previous videos in this series and I got the feeling I understood it :D Amazing, thank you! CRC next..

[@neilclay5835]

Outstanding lesson

[@username17234]

Very instructive and interesting, great job.

[@waspoza]

You are doing amazing job, sir. Top notch education. Thank you!

[@zhenzhang3451]

Omg you back! Finally waiting for you for a long time

[@caxco93]

HE'S BACK!!!! LORD BENEATER IS BACK!!!

[@joeybushagour2612]

Great video as always Ben!

[@Atemu12]

Very interesting, thanks! Will you also do a video on error correction?

[@toncho1986]

Finally!... where have you been? I missed you a lot buddy.. You know, we love your videos! :D

[@romanemul1]

Keep those videos comming Ben.

[@cibrinyark339]

I was wondering why this appeared in my sub feed. After watching I now understand. It's crazy how people come up with stuff like this

[@kd1s]

Imagine the checksums on credit/debit cards too. I learned how to break that one down a few years ago. And I remember checksums and hamming code from a college class many years ago. And if you take that 17 modulo 11 you get 6.

[@mohsend72]

The ISBN example for the checksum was the most beautiful example of a checksum for a layman (not a computer geek). I'm gonna use if I ever had to explain checksum to those who are not familiar with digital logic.

[@Roxor128]

A similar checksum applies for your regular product barcodes, too. Sure, they're usually read by a laser, but there's a checksum in there for when the number gets entered by hand.

[@kaitlyn__L]

@@Roxor128 it’s still used to verify the laser or optical input, to catch dirt on the barcode or dust in the air adding extra lines (bits) :) plus of course barcodes are mirrored, both to enhance rotation-compensation but also as another way to catch a mistake. Then you have to re-scan the item until it works

[@oldgnuts6576]

Its amazing that you used hamming distance. I learned the concept from cryptography. I realize now, how, the most popular example of exploiting that concept takes absolute advantage of it. And parity and checksum. It is enlightening to observe how it worked behind the scenes and it is (saliva productively) so simple to understand. I thought the hardware had more layers of abstraction but I realize its basically chips built with similar logic all in one chip and there were no regards to security. Just computing. And more than likely whoever could produce faster cooler things.

[@oldgnuts6576]

Data could not be safe in that system.

[@oldgnuts6576]

It would not surprise me if you can raise a million. Its really so much easier than people think. I have a 4th year who I am looking for a lab to work in. He's looking for an undergrad program to work/study in while he grinds his thesis. If you meet that criteria, I have a brilliant young man and he is dedicated to furthering his education. I hope he follows my advice. And he also has access to me. Which is fortunate for him.

[@fluffy_tail4365]

Crc hype!

[@simeondermaats]

why did i read this as creedence clearwater revival

[@TheDabol51]

That video made my day... or should I say made my month/year?

[@Mau365PP]

He's back !!!

[@eirikgg]

Great video ! CRC tease, I whant to look it up now. But your videos are so much more educational

[@shahabbangash5499]

Love to see you back😍

[@vikranttyagiRN]

Legend is back.

[@fabian999ification]

He's back!!! He's BACK!!!!!!!

[@StevenHokins]

Thanks for video Ben

[@fluteplayerify]

I am looking forward to the video on CRC

[@Ctenaphora]

Welcome back Ben!

[@borisdorofeev5602]

Ben's back!

[@SKCLLC]

Great explanation! Thank you for the awesome videos!

[@vasekdvor]

I hope that we won't be waiting for "crc" video as long as we waited for this video.

[@MaxPicAxe]

Great video as usual

[@terrongd]

These videos are amazing!! Keep making them!! :)

[@lolechi]

Excellent video!

[@gazzacroy]

really cool video, your a very clever guy and I love the way you teach top stuff..