What is a File Format?

  Рет қаралды 180,120

LiveOverflow

LiveOverflow

Күн бұрын

Let's explore what a file format is, and provide a different view on it. We dive into polyglots, file format research and the impact on security.
Funky File Formats Talk: • Ange Albertini: Funky ...
corkami/mitra tool: github.com/cor...
Guessing vs. Not Knowing featuring Steganography: • Guessing vs. Not Knowi...
=[ ❤️ Support ]=
→ per Video: / liveoverflow
→ per Month: / @liveoverflow
=[ 🐕 Social ]=
→ Twitter: / liveoverflow
→ Instagram: / liveoverflow
→ Website: liveoverflow.com/
→ Subreddit: / liveoverflow
→ Facebook: / liveoverflow

Пікірлер: 510
@philipk883
@philipk883 3 жыл бұрын
Aah yes! the Schrodinger's zip file.
@thefridge6913
@thefridge6913 3 жыл бұрын
I laughed at this a little too hard.
@NestiGaming
@NestiGaming 3 жыл бұрын
That cat example doesn't seem that random...
@AjayKumar-fd9mv
@AjayKumar-fd9mv 3 жыл бұрын
അടിപൊളി
@chregig7967
@chregig7967 3 жыл бұрын
@@thefridge6913 you can never laugh too hard :D
@mouaztabboush5571
@mouaztabboush5571 3 жыл бұрын
Schrödinger doesn't like this trick
@Sunpy_Emily
@Sunpy_Emily 3 жыл бұрын
The scene with dark background, a table and a simple t-shirt makes this feel like an interrogation scene where police is asking the criminal questions.
@SamuelCarreira
@SamuelCarreira 3 жыл бұрын
I really like this scenario, for me doesn’t look any like that... but only a minimalist and well filmed scenario. No more that typical youtuber background bullshit with their setup behind
@tilakmadichettitheappdeveloper
@tilakmadichettitheappdeveloper 3 жыл бұрын
#hackersroom
@ultraviolet.catastrophe
@ultraviolet.catastrophe 3 жыл бұрын
"We know you work with the File Format Cartel! Who is your leader?!?"
@NStripleseven
@NStripleseven 3 жыл бұрын
Except instead, he’s answering questions nobody asked.
@YotaNinja
@YotaNinja 3 жыл бұрын
I remember my first time learning about this file format trick was probably about 2005-2006 on 4chan of all places. Someone uploaded an image, it was the cover of a C++ textbook, or some C language. I can't quite remember, but what I do remember was you could download the image, and extract that exact document from it. They embedded the textbook within the image itself, and used any image hosting site to discretely share it with people. I was blown away.
@shady4tv
@shady4tv 3 жыл бұрын
I'm someone in the category of people freaking out about closed source binwalk so I see files agnostically already. But I thought - "Hey, If I give this video a chance I'm sure LiveOverFlow will teach me something new" - All I can say is WOW The idea of not encapsulating but "programming" a file into the zip format is a complete paradigm shift. I will never be able to look at files in the same way again holy shit bro you just blew my mind.
@stevepoper8073
@stevepoper8073 3 жыл бұрын
I remember being blown away by file extensions when I played DDLC
@imgladnotu9527
@imgladnotu9527 3 жыл бұрын
Dont We All................... just monika ngl LiveOverflow should check out/play games that have neat tricks like what ddlc does, and im pretty sure there are obscure as heck ones out there.
@frni
@frni 3 жыл бұрын
You can do this in windows with the copy command and the /B switch for binary "copy /B picture.jpg+folder.zip new.jpg" I learned this when I heard that a promotional desktop wallpaper for Portal had an Easter egg in it. If you opened it as an archive the ending song "Still Alive" mp3 was in there. This was a triumph!
@joshinils
@joshinils 3 жыл бұрын
"grew up with a commandline" yes, you could say that i grew up when i started using linux a few years ago
@helper_bot
@helper_bot 3 жыл бұрын
I'd like to point out some flaw in the video 1. The Person A and Person B analogy, rather than just "liking" it should've been "only knowing" or "ignoring except". PDF program would read the PDF code, and not the ZIP code, and the other way around for Zip programs 2. Rather than changing the file name extensions, you could probably just run the file with the program right away. Though I'm not sure since I haven't tried it, but I'm sure it would run as is. Anyway, great video as usual, thanks for sharing this information with us!
@kanucks9
@kanucks9 3 жыл бұрын
11 minutes in "I don't know exactly why the pdf isn't shown in the zip file" Dude that's literally the only reason I watched this video.
@petey5009
@petey5009 3 жыл бұрын
The pdf file is probably contained in a place where the zip program doesn't check, and pdf headers don't need to start at the beginning
@oODomeeOo
@oODomeeOo 3 жыл бұрын
@@petey5009 Since the PDF is in the Zip record it is probably checked by the Zip program. But since it has no filename it is simply not displayed.
@giantbee9763
@giantbee9763 3 жыл бұрын
He does know why, just not precisely what the reason is in this particular case. In this particular case it could be anything, depending on the way the zip format is there might be many ways to hide the pdf. You just need to find a way to make the information redundant, like making things a comment in the earlier polyglot C php bash etc example. :)
@erickcardozo462
@erickcardozo462 3 жыл бұрын
That's because the PDF file was not zipped, its contents were just combined with the contents of the zip file in the final generated file. So when the zip program reads the final file, it encounters the only thing that was zipped in that file: the text file. It's not that hard to get 🙂
@31redorange08
@31redorange08 2 жыл бұрын
@@erickcardozo462 You should watch the video.
@Brlitzkreig
@Brlitzkreig 3 жыл бұрын
Wow, you make it so easy for people to understand these complex topics!
@hypergraphic
@hypergraphic 2 жыл бұрын
This gives me new appreciation for the mantra: parse don't validate. If you just look for what you are expecting, you might admit more than you were bargaining for.
@Basepilot
@Basepilot 3 жыл бұрын
love the example with the "Town Musicians of Bremen " :)
@0okaze
@0okaze 3 жыл бұрын
À true hacker spirit, reminds me of my youth. It pleases me to see young talents, there are so few of them, while I thought 30 years ago that there would be countless hackers far better than us in the future. It never happened, everything has gone down, so these videos are refreshing.
@Crux161
@Crux161 3 жыл бұрын
This is one reason why simple things like the `file` command in Linux are *so useful*
@FennecTECH
@FennecTECH 3 жыл бұрын
I think the CTF about finding the hidden stuff in a file would be a great challenge for a stego CTF. And it is valuable experence in identifying stego. And if your getting into information security stego experence is very important.
@nohbdy9634
@nohbdy9634 3 жыл бұрын
This is great, the education was great, and the whole building up to the message about the CTFs was hilarious, but I 100% agree.
@olbluelips
@olbluelips 3 жыл бұрын
Great video, I love thinking of zip as interpreter for .zip "source code"! I also just love the concept of weird machines Recently, for educational purposes, I've written a couple of image file formats and also I'm writing an interpreter, so this is right up my alley :)
@Yaxqb
@Yaxqb 3 жыл бұрын
File formats based on extension: Windows virgin. File format based on actual content: Unix file CHAD basedlord
@MrFram
@MrFram 3 жыл бұрын
MIME types: Our new web overlords
@zakuarbor
@zakuarbor 3 жыл бұрын
Great video. I recalled how many students were amazed when I had students extract an image from a PDF in my seminar course (a course where students teach the class) where I talked about stegosploit. Makes you think what files could be hidden in a PDF. However, that was only the start of it because the toolkit created by Saumil Shah, the person who created Stegosploit, hid the toolkit inside the image. So you had to rename the image extension to HTML and open it in the browser to obtain the toolkit. I was also very shocked when I first was researching the topic.
@SriHarshaChilakapati
@SriHarshaChilakapati 3 жыл бұрын
I used to do this with BMP images. Compress all your files, and combine them with a BMP image of your choice. Just a simple copy command in cmd will work and you can hide some stuff from people. copy /b image.bmp files.zip image2.bmp. I used to hide my games in school lab PC this way.
@SriHarshaChilakapati
@SriHarshaChilakapati 3 жыл бұрын
This is also exactly the way SFX archives work. Open an SFX archive (.exe file) in any Zip program and it will show the contents. Fun stuff indeed.
@michamarzec9786
@michamarzec9786 3 жыл бұрын
That was very informative and entertaining. Learn something new today. Thanks :D
@RahulRaj-pd7gi
@RahulRaj-pd7gi 3 жыл бұрын
No this type of ctf challenges are not at all annoying infact I solved this type of challenge yesterday and learned alot about file extension and that's how I reached to this video. You explained everything perfectly. Thanks
@ozgun228
@ozgun228 Жыл бұрын
A video topic suggestion: how to make your own file format. That would give us more intuition in the topic.
@nagitokomaeda3237
@nagitokomaeda3237 3 жыл бұрын
This reminds me of that time I concatenated a shell script unzipping itself with a zip file to have basic self-extracting archives.
@MateHegyhati
@MateHegyhati 3 жыл бұрын
Thanks, I'll bring this example up at my Formal Language Theory classes. This is a fun way to talk about the intersection of formal languages. :-)
@SeaHay
@SeaHay 3 жыл бұрын
This seems like a really cool way to install a smallish program while making sure someone reads the README file first and foremost
@HolowatyVlogs
@HolowatyVlogs 3 жыл бұрын
This is really interesting, I’ve never heard of polyglot computing! This kinda reminds me of steganography.
@user-vn7ce5ig1z
@user-vn7ce5ig1z 3 жыл бұрын
Because steganography often uses this as the method of embedding data. That said, not all cases of this are steganography, for example, a self-extracting archive is seen by the shell as an executable file but as an archive by the archive program. (An archive program is usually involved with these.)
@ewenlbh
@ewenlbh 3 жыл бұрын
6:26 Here's a triple syntax-highlighting image that can help understand how this can be valid PHP, C and Bash at the same time i.imgur.com/f7a4Uqu.png
@svampebob007
@svampebob007 3 жыл бұрын
Nice! that should be uploaded to Wikipedia it would make it visually clear! en.wikipedia.org/wiki/Help:Adding_image en.wikipedia.org/wiki/Polyglot_(computing)
@clippy3656
@clippy3656 3 жыл бұрын
I love how you turned on dark mode in the intro
@ArthursHD
@ArthursHD 2 жыл бұрын
Oh, expected there to be an error since PDF is not using deflate like docx and odf files. Clever way to manipulate file to run it in multiple programs successfully :)
@abstractapproach634
@abstractapproach634 3 жыл бұрын
Both approaches for flags are useful imo
@aboutcloud7661
@aboutcloud7661 Жыл бұрын
Those animals on the thumbnail. Those are the Bremer Stadtmusikanten.
@narayanbandodker5482
@narayanbandodker5482 3 жыл бұрын
LiveOverflow has finally enabled Dark mode!
@bancodrut
@bancodrut 3 жыл бұрын
For a second there I thought this was some bare entry-level tutorial ... saw the channel name ... Wait a second 😂 Nice video btw. I was thinking about something similar and it's nice to know that it has been already researched (cus I'm lazy as fuu)
@Fabelaz
@Fabelaz 3 жыл бұрын
*.rar.jpeg was the file format monstrocity I knew about before. Considering what you showed here, wonder how much pairs or tripletts can be made with popular programs.
@bullfrog9296
@bullfrog9296 3 жыл бұрын
While challenges that teach how to apply steganographic techniques are great (like your example), I wonder what challenge you would create to actually teach someone how to identify stego. I agree with you that guessing at the technique seems silly, but maybe a challenge that gives you a normal looking website, with steganography applied somewhere, and you could be tasked with finding the file that contains another file. This way, you wouldn't have to guess at the method, but you could improve your analytic skills by, say, looking at the file sizes of images on the websites to see if one looks abnormally large, or if one has weird file headers like having both PK and JFIF. Maybe have a stretch goal giving a few extra points for getting the file out, but the main goal would be finding the "malicious" file in the first place. Or say "somewhere on this website there is a zip file containing a pdf hidden in one of the images". The solution to the challenge could be to scrape all the images from the site and sort them by file size to get the most likely candidates, or scraping them then writing a python script to search for the magic bytes of a zip file or something. That way you'd know ahead of time what technique you're going to be applying, and you'd learn how to identify when it is being used and gain some familiarity with looking at files hidden with this technique. Thoughts? (I've only done CTF challenges, never written any, so if this idea sucks feel free to say so!)
@Julesoby
@Julesoby 3 жыл бұрын
Very interesting video! I do recommend to change the title to something more fitting/attractive, maybe 'How a file can have multiple extensions'. I almost skipped this video because I thought it was just an explanation of file headers!
@damiancampbell1743
@damiancampbell1743 3 жыл бұрын
6:30 Agnosticism as a programming language
@shady4tv
@shady4tv 3 жыл бұрын
12:15 -> OverTheWire challenge Natas level 12 goes over this concept too but with images files and php.
@MrProfizmus
@MrProfizmus 3 жыл бұрын
Great video, minus perhaps the whiff of command line evangelism in the beginning. You can easily come across scenarios where you manually override which program you want a file to be opened with, even in a GUI environment, such as when you want to edit an image instead of viewing it - dismantling the argument right away (you consciously make the file consumed by a non-default app of your choice). Going back to CLI, consider shebangs: how often is it that you execute e.g. a shell script by passing it directly to a shell program, rather than invoking it straight away? Not so often, I'd imagine. But even beyond all this, I find the whole default program thing to not really be a barrier of any sort in understanding this. Maybe this is just me not being a computer novice though, I don't know. Thinking about files as being "programs" however was definitely a food for thought, I quite enjoyed that.
@protectyourbits
@protectyourbits 3 жыл бұрын
About 90% of the content you post is way over my head and i wouldnt be able to use it in real life. But i still love your videos. You explain these things in such a way that i can atleast gain a better understanding of basic computer functions. Which helps with my logic and thinking about certain issues i come accross sometimes. Love your stuff. Keep up the good stuff!
@willemschipper7736
@willemschipper7736 3 жыл бұрын
Whoa LiveOverflow dark mode
@AbhishekNigam
@AbhishekNigam 3 жыл бұрын
Awesome video!
@PinePizza
@PinePizza 3 жыл бұрын
Ehm.. Why does the thumbnail show the "Bremer Stadtmusikanten"? This is the symbol of my home city in Germany lol, didn't expect to ever see that on KZbin!
@donaldduck6198
@donaldduck6198 3 жыл бұрын
MS-Office malware applies often a combination of files to hide VBA-Code
@toranine09
@toranine09 3 жыл бұрын
i’m wildly simplifying, but i learned this “(malware) scanners look for code based on file extensions” thing ages ago - used to change file formats to get around automatic file rejection systems all the time. file hosting site rejecting your zip containing copyright music? it wont look for audio if you’re uploading a weirdly corrupted png file!
@toranine09
@toranine09 3 жыл бұрын
i also used to fake corrupt my homework by copying a file, opening it in a text editor, and filling a blank document with the output, scrambled twice in case any smartass teacher tried to reverse engineer the document and “uncorrupt” it
@RohitSaini-t4r
@RohitSaini-t4r 6 ай бұрын
this is helpful knowledge
@igorgiuseppe1862
@igorgiuseppe1862 3 жыл бұрын
0:20 i made it by accident on win98, by overwriting an file... or something... back in the days i created an folder called "strange documents files" for all the experiments i did, i had a lot of files with strange bugs that i didnt knew why those bugs happens or what i did wrong that created those bugs. unfortunatelly i dont have those files anymore >.> , i doubt they work on modern systems anyway, but i lose then because i couldnt afford to backup anything back then.
@svampebob007
@svampebob007 3 жыл бұрын
"i couldnt afford to backup anything back then" Just like we lost a lot of good valuable information with the fall of alexandria's library, we lost a lot of good code/info from the early ages of computers and the internet because we just didn't have enough storage, or ways to save all this good stuff :(
@lightning_11
@lightning_11 Жыл бұрын
These kinds of tricks seem very popular on Discord. People like making videos that are different every time you play them and weird things like that...
@James2210
@James2210 Жыл бұрын
I can't find the 010 tool you mentioned anywhere, can you please link it in the description?
@LiveOverflow
@LiveOverflow Жыл бұрын
Can you google “010 editor”?
@yetzt
@yetzt 3 жыл бұрын
but what about matroshka challenges, that are only about cunning steganography?
@solonovamax
@solonovamax 3 жыл бұрын
I'm here a bit late, but I'm going to explain why I think it's not showing the pdf as a file: Basically, what I *believe* it's doing is the zip file doesn't think the file has "started" until _after_ the pdf. What I mean by that is: zip files are able to actually have a blob of arbitrary data in front of them which they will ignore. They only read everything after a file signature, which is 0x04034b50. I found this a while ago in a stack overflow post which basically took an executable script and a jar file and combined them. All the script did is it ran itself using the `java -jar` command. You can find it here if you want: stackoverflow.com/a/41829433 But I believe this is probably doing something similar: the zip file doesn't "start" until the end of the pdf, so it ignores that huge blob of data it doesn't understand. And the pdf file "ends" before the zip file, so it just ignores the blob of zip file data that _it_ doesn't understand. (Which I assume would be indicated by a couple of bytes that are used to "end" the pdf.) This way, you can contain multiple files within the same file and have them be read differently. Because each program starts reading after a certain set of bytes and stops after another set of bytes.
@ScottMaday
@ScottMaday 3 жыл бұрын
I've always thought of file extensions as part of the file name, but tell the user and the operating system what kind of data to expect when dealing with it
@drawapretzel6003
@drawapretzel6003 3 жыл бұрын
Technically theres both, the physical data headers inside the file, and the text extension in the name. If you omit the internal header, you have to use an external (the name) to find the format it is laid out in, or tell a specific program to open it, but ironically, the name is also technically inside the file itself, so its still inside the file even if its outside the file. You can also do the opposite, have no external file extension, or a different one, and then have internal file headers to tell the program you open it with what data to pay attention to. Thats all thats happening here, two files, two file headers, in one file, and each program that opens it ignores the internal data not packaged properly. I mean heck, imgur did this for their scavenger hunt almost a decade ago now, hid text in a jpg or png file that when you opened it in a text editor told you the url for the next step.
@sdjhgfkshfswdfhskljh3360
@sdjhgfkshfswdfhskljh3360 3 жыл бұрын
And that is the best way. Guessing (Linux-style) may go wrong in many ways.
@i_sometimes_leave_comments
@i_sometimes_leave_comments 3 жыл бұрын
Do you know some hex editors for Linux with decoding abilities similar to 010?
3 жыл бұрын
Now u need a hoodie
@abhisekhmukherjee4408
@abhisekhmukherjee4408 3 жыл бұрын
Awesome 👍
@Blazagg
@Blazagg 3 жыл бұрын
A little sad this didn't touch on the behavior of different PDF viewers / zip archivers when looking at the same file. Although I understand this could be a bit besides the point, it's also interesting to note that because they are different implementations, they could differ in behavior. It's a bit less about file formats and more about about their "interpreters", I guess. Example: docx file format is open, but its rendering isn't. So Chrome, Word Mobile, Microsoft Word, LibreOffice, etc. can render an exact same file differently. I've also encountered some docx documents that opened fine on Chrome, but were said to be corrupt in Word.
@LiveOverflow
@LiveOverflow 3 жыл бұрын
I did mention that in this video. Gave the example with antivirus ;)
@tjmarx
@tjmarx 3 жыл бұрын
I disagree regarding guessing challenges in CTF. Guessing has value in application of skillsets and building muscle memory. A good CTF challenge should include a balanced mixture of skill development portions, like you are advocating for and some elements of guessing.
@arisweedler4703
@arisweedler4703 3 жыл бұрын
Zip files can contain “deleted” files - it was easier to append to them and update the footer/index than to physically remove files from them. The PDF doesn’t show up as a file because the footer simply doesn’t reference it! Seems ironic that a zip file is allowed to be so inefficient in terms of storage, when that’s what I used to think it was for!! But I think that historically it was really just used as a way to group files together, optimized with respect to slow/old technologies! (Tape, disks) Responding to 10:40
@arisweedler4703
@arisweedler4703 3 жыл бұрын
I was just learning about this last week! From Wikipedia: Because ZIP files may be appended to, only files specified in the central directory at the end of the file are valid. Scanning a ZIP file for local file headers is invalid (except in the case of corrupted archives), as the central directory may declare that some files have been deleted and other files have been updated.
@arisweedler4703
@arisweedler4703 3 жыл бұрын
The entire section titled “design” is a very good read. Another notable possibility is that the zip file central directory block @ the end can declare 2 files with the same name!! - I wonder what happens then when you try to list them out. If you try to extract, one file will probably get overwritten! If you try to list, it could show both
@arisweedler4703
@arisweedler4703 3 жыл бұрын
Here’s the specific quote from Wikipedia en.m.wikipedia.org/wiki/Zip_(file_format) where it makes sense for zip to be like this! When ZIP was first designed, transferring files by floppy disk was common, yet writing to disks was very time consuming. If you had a large zip file, possibly spanning multiple disks, and only needed to update a few files, rather than reading and re-writing all the files, it would be substantially faster to just read the old central directory, append the new files then append an updated central directory.
@peacemekka
@peacemekka 3 жыл бұрын
Me windows pleb when he opened the same file as .zip and .pdf : **X-Files music**
@yuxin7440
@yuxin7440 3 жыл бұрын
This video is pretty fascinating. With many years of experience using Linux and command line, I am already familiar with the fact that file format is just a trick (every file is just a binary stream anyway), but I am sill surprised that you can easily craft files to be interpreted by multiple programs differently. I am not sure whether it's a good thing or a bad thing. From a developer's perspective, we want the file format to be unambiguous, because we know from experience that ambiguity is a common source of bugs and unexpected behaviors. However, sometimes we also want flexibility and tolerance. For example, we want to add more features to file format but not break the older version program, which means we shouldn't be overly strict on recognizing format. These two design principle are sometimes conflicting to each other, and I think it is the main cause of the issue.
@redpanda31337
@redpanda31337 3 жыл бұрын
@@00O3O1B a word file is also just a zip file
@nagitokomaeda3237
@nagitokomaeda3237 3 жыл бұрын
this is why magic numbers exist
@Blast-Forward
@Blast-Forward Жыл бұрын
It also doesn't sound very efficient to put different "files" into the same file for most use cases.
@joachimprz
@joachimprz 3 жыл бұрын
Roger, LiveOverflow gone Dark Mode
@rogervanbommel1086
@rogervanbommel1086 3 жыл бұрын
Why use my name?
@bruh_5555
@bruh_5555 3 жыл бұрын
I was searching for this comment🤣🤣
@TimLF
@TimLF 3 жыл бұрын
I love dark mode. I wonder what % of 0.5M viewers are on OLED and how much energy was saved.
@machinexa1
@machinexa1 3 жыл бұрын
Black lives matter
@Architector_4
@Architector_4 3 жыл бұрын
I honestly like the light mode more. Not only it feels more reminiscent with what I associate with the channel, keeping it light at all times prevents eye whiplash like at 0:55 where the light fills the entire video instantly.
@johnny5gr
@johnny5gr 3 жыл бұрын
The conversation went like this: - WTF did you do? - You dog... - Zip it man!
@solomioist
@solomioist 3 жыл бұрын
LiveOverflow: „You don’t want to do PDF by hand“ Me: *cries in LaTeX*
@ra1d3r34
@ra1d3r34 3 жыл бұрын
i feel you!
@blackneos940
@blackneos940 3 жыл бұрын
What is Latex, some condom ingredient?
@int16_t
@int16_t 3 жыл бұрын
A typesetting tool.
@Cobalt985
@Cobalt985 3 жыл бұрын
LaTeX is fucking incredible. Also if you like meme ways of writing your documents check out groff/troff. Much simpler than LaTeX. Or, just start converting markdown/emacs org-mode to LaTeX. That takes the pain out of it. I wrote all my Bio notes in org-mode then compiled it into a final LaTeX document without much trouble.
@flp322
@flp322 3 жыл бұрын
LaTeX by hand is much easier than PDF by hand.
@MrKristian252
@MrKristian252 3 жыл бұрын
If anyone has seen this image going around on Discord; "Please don't open me in the browser". Basically 2 image png animation. Renamed to .zip, gives a .mp3 file inside, containing some metadata about opening the audio in a image viewer. Pretty cool, took half of the day to get to the end of it.
@zekiz774
@zekiz774 3 жыл бұрын
Yes. I'm not the only one. I just posted this video in the discord server.
@atharvavaidya6230
@atharvavaidya6230 3 жыл бұрын
Looks interesting. Can you post a link here?
@zekiz774
@zekiz774 3 жыл бұрын
@Nigel YING No. It's not quiet the end. Try to do "file" on the happiness file
@E404NNF
@E404NNF 3 жыл бұрын
I saw the one which only works on VLC (not the UWP version)
@panagiotispetridis7961
@panagiotispetridis7961 3 жыл бұрын
I really like this type of videos. The explanations where really good the quality is very high and overall I can confidently say that I've learnt something I didn't know before!
@SimonHuenecke
@SimonHuenecke 3 жыл бұрын
How dark should the background be? Live overflow: YES
@Hyperboid
@Hyperboid 3 жыл бұрын
"YOU decide what to open the file with" xdg-open: exists
@hafidhzouahi7146
@hafidhzouahi7146 3 жыл бұрын
LiveOverFlow: hiding files in files is not fun justCTF: yes
@Jagnathbaba
@Jagnathbaba 3 жыл бұрын
I always used to think that these formats are "strict" as in they wouldn't allow unknowns. Turns out they do and you can play tricks with them.
@Rudxain
@Rudxain 2 жыл бұрын
_[HTML without DOCTYPE has entered the chat]_
@otkchk
@otkchk 3 жыл бұрын
LiveOverflow 2016 - finding a parser differential in loading ELF LIveOverflow 2020 - what is a file format just joking. top notch stuff I didn't know.
@HootanHM
@HootanHM 3 жыл бұрын
Now that this secret is public, I want to confess. ✝️ It was my trick in all teen years to hide my private content in a shared pc with family. Of course, we had different users but windows 98, ME and XP were so kind to let me browse other users files. So, I imagined that maybe someone else can browse my files too... Even if they managed to gain access to my files they didn't know if they change the file suffix/extension they see a whole new thing I don't exactly remember which year I learned about file format, but it was between 2000 and 2002.
@BGroothedde
@BGroothedde 3 жыл бұрын
The 010 tool is pretty awesome, reminds me of something similar I made for terminals - but more advanced and with a hex editor. Thanks for sharing that!
@uuuuuhhlettuce3909
@uuuuuhhlettuce3909 3 жыл бұрын
omggg u finally made a dark mode intro. 🙏🏿🙏🏿🙏🏿
@TheKinGG0ld
@TheKinGG0ld 3 жыл бұрын
Love the musicians of bremen image and the new videos format!
@nahu4870
@nahu4870 3 жыл бұрын
2:38 There's is magic though! At the first bytes of the file
@4g3v
@4g3v 3 жыл бұрын
010's template feature is the best one I have seen yet in any hex editor. It's really useful for reversing proprietary file formats.
@MulleDK19
@MulleDK19 3 жыл бұрын
Nothing beats Hex Editor Neo. Unfortunately it's not free.
@DM-qm5sc
@DM-qm5sc 3 жыл бұрын
Thank you for dark mode!
@iooosef6006
@iooosef6006 3 жыл бұрын
YOU CAN DRAG FILES TO NOTEPAD???!!!!
@sectokia1909
@sectokia1909 3 жыл бұрын
A rather long winded video to say: PDF ignores bytes until it finds headers. Zip won't show files that have zero length set in headers. So you can make a file that is both a valid PDF and a valid ZIP with another file in it.
@jaywankhede3426
@jaywankhede3426 3 жыл бұрын
If u are here from jusctf gimme a link or else.
@zuzanahroudova9028
@zuzanahroudova9028 3 жыл бұрын
Dark mode for intro :)
@svampebob007
@svampebob007 3 жыл бұрын
Files being source code is so blatantly obvious I never though of it, but when you pointed it out it instantly made sense how one could play with the file. and espessially when you showed that ansicphpbash "file format" :) How many of us have struggled with one code trying to parts a bit of another code as a string/variable, or what ever, only to realize you forgot to reformat it so that the thing you're trying to pass is not a being interpreted as actual code.
@MeriaDuck
@MeriaDuck 3 жыл бұрын
2:38 LOL at no magic joke 😀 For those new to this, the linux file format recognizer (the file command) is configured in a file called /etc/magic
@TimLF
@TimLF 3 жыл бұрын
Anyone ever use that file? I though it just stayed empty and people used defaults, #!, /usr/share/applications/, or whatever.
@samfoxman7046
@samfoxman7046 3 жыл бұрын
The term "magic" comes from en.wikipedia.org/wiki/Magic_number_(programming)
@1Hippo
@1Hippo 3 жыл бұрын
Just checked on my system, /etc/magic does not exist. So at least for Arch Linux it is in /usr/share/file/misc/magic. It reads a compiled version (.mgc) first.
@sreejithsubhash7301
@sreejithsubhash7301 3 жыл бұрын
File exists in Ubuntu 😃
@nahu4870
@nahu4870 3 жыл бұрын
Pretty sure the joke was about the magic numbers like Sam said It's the first few bytes of a file / the signature which you can teoad to find out the format and other info like the version of the program uses to create that file
@ahweikun
@ahweikun 3 жыл бұрын
porn collectors be like: after all these years trying to hide our collections and now you show this?
@cannaroe1213
@cannaroe1213 3 жыл бұрын
I like this channel a lot :) I really liked how you explained that zip files actually program zip to make a file, rather than "contain" data. You could have brought in zip-bombs at this point, because then a 1Kb file making a 42Gb file kind of shows how it's generative. Having said that, I think you made one point unclear, which was that programs sometimes "ignore" bytes they don't understand, like scanning for a dog and not seeing the cat. PDF is weird in that it looks for it's magic sequence anywhere in the file, ignoring the zip at the beginning. ZIP, for example, wont do this. Python wont do this. etc etc. Nevertheless, through use of commenting, which is like programming zip to deliberately ignore code, you make polyglots. Polyglots almost always use commenting. If commenting wasn't possible, making polyglots would be WAY harder! Programs don't typically ignore anything, unless you trick them into it. Also this whole video strikes at the heart of a big problem in Europe, what does data privacy/security/illegal information actually mean? What if a picture file, for example, looks like a beautiful sunset in one image viewer application, but child-pron in another. Is the *file* child-pron, or is the image-viewer *making* child-pron when it's displayed? Or both? Do you need to have both on your computer to break the law? TL;DR we all have child-pron and state-secrets on our computers, sometimes in the same file, we just don't have the software to view it.
@TimLF
@TimLF 3 жыл бұрын
Should have been said Linux has "xdg-open" and "file" to not scare the windows users to much.
@BeefIngot
@BeefIngot 3 жыл бұрын
@@egesanl1 Pure elitism. Its the biggest problem with the linux community. Its how they repeatedly shoot themselves in the foot while pretending they actually want it to become more mainstream so it actually gets more big company support.
@skipfred
@skipfred 3 жыл бұрын
@@egesanl1 Most people are dumb. Therefore most Windows users are dumb. Not knowing how to install or use Linux doesn't mean you are dumb, but generally being able to install and use Linux means you are at least smart enough to understand some basic lower level computing concepts. Windows comes on most PCs by default so there's no "filter" like there is with Linux. Claiming that if you use Windows you are dumb is equally dumb. I run Linux or Windows depending on what I need to do - the right tool for the right job. But it's not a totally unwarranted assumption that people who only use Windows are generally less knowledgeable about computers.
@skipfred
@skipfred 3 жыл бұрын
@hgfd
@dxykhang
@dxykhang 3 жыл бұрын
What if a CTF challenge goes like this: it's a .pdf file and also is a .zip file. The .pdf gonna be something that will make people to find for a real .txt that writes "Psst, this pdf file can also be executed by zip" lol
@RichardiOS275
@RichardiOS275 3 жыл бұрын
the thing that went in my head when I see 6:26 is C I didn't realise there's php and bash until you told us
@UjjwalKumar-wg4wu
@UjjwalKumar-wg4wu 3 жыл бұрын
loving the new brand design
@p.9227
@p.9227 3 жыл бұрын
My mind was absolutely blown away. I've never thought that the same file could be interpreted differently. This is eye-opening for me.
@bramble-east
@bramble-east 3 жыл бұрын
I remember my frustration when first switching from Windows to Ubuntu for work projects. I didn't understand how the Ubuntu file system structure worked, how I should manage individual files, and how to work with them. I asked people questions like "Where should I install programs in Ubuntu?" and similar. At that time I thought to myself self "Gosh, Windows seems like a much cleaner system, everything is neatly organized, I have a dedicated folder for Program Files and the only thing I should do is click shortcuts". But after learning the Ubuntu FS layout, understanding how PATH actually works and what is it intended for, and a lot of other tips and tricks Windows FS principles feel rather restrictive. Although I now daily-drive Windows for home and work stuff (Windows made MAJOR progress towards being a developer-friendly system in the last few years), I still miss some of that clean simplicity and infinite possibilities that a proper GNU/Linux system provides.
@ok-tr1nw
@ok-tr1nw 3 жыл бұрын
4:58 yo why the virus looking like sans
@ICe-ph5mr
@ICe-ph5mr 3 жыл бұрын
Tha thing from the Thumbnail is called "bremer Stadtmusikanten" it's a statue in bremen (germany) lel
@c2ashman
@c2ashman 3 жыл бұрын
I opened this video with Microsoft Excel.......now my Windows OS is patched and has 0 security bugs. Thanks.
@MulleDK19
@MulleDK19 3 жыл бұрын
Didn't have to be part of the zip structure (as long as the entire ZIP file is less than 1024 bytes). This is a side effect of the PDF format, which allows random data in the first 1024 bytes.
@Basieeee
@Basieeee 3 жыл бұрын
Don't start talking about .lnk files
@involute-g5y
@involute-g5y 3 жыл бұрын
from justctf
@mushenji
@mushenji 3 жыл бұрын
cool stuff. This is the time to weaponize it.
@Sankaritarina89
@Sankaritarina89 3 жыл бұрын
I can totally relate to this. Grew up with windows but entirely switched to Linux like 8 years ago. I have a completely different understanding for the filesystem now.
@LeoStaley
@LeoStaley 3 жыл бұрын
Over the last twelve years, I have tried to switch over to Linux no less than 6 times. I am driven insane by trying to deal with obscure problems, and have to turn back to windows every time. Perhaps it's just because I'm not a coder and am just a power user. But if a power user like me can't take the frustration of Linux, I can't imagine normal people ever being able to take it.
@Sankaritarina89
@Sankaritarina89 3 жыл бұрын
@@LeoStaley if you are a windows user who needs windows it will be difficult I guess. I'm a software engineer, so I have a big benefit from using Linux and only downsides when using windows so that made the decision easy for me.
@lilyliao9521
@lilyliao9521 Жыл бұрын
@@LeoStaley never fully switch to linux, dont get tricked by the masochistic nerds
What is a Browser Security Sandbox?! (Learn to Hack Firefox)
18:06
LiveOverflow
Рет қаралды 143 М.
Generic HTML Sanitizer Bypass Investigation
14:05
LiveOverflow
Рет қаралды 141 М.
Players vs Corner Flags 🤯
00:28
LE FOOT EN VIDÉO
Рет қаралды 70 МЛН
Cute
00:16
Oyuncak Avı
Рет қаралды 12 МЛН
Стойкость Фёдора поразила всех!
00:58
МИНУС БАЛЛ
Рет қаралды 3,5 МЛН
Nastya and balloon challenge
00:23
Nastya
Рет қаралды 67 МЛН
What Kinds of Files Can Be Viruses?
14:08
ThioJoe
Рет қаралды 278 М.
Why MissingNo Multiplies Items!
21:36
LiveOverflow
Рет қаралды 179 М.
BINARY vs TEXT File Serialization
13:49
The Cherno
Рет қаралды 52 М.
Explaining Digital Video: Formats, Codecs & Containers
14:43
ExplainingComputers
Рет қаралды 285 М.
How A Steam Bug Deleted Someone’s Entire PC
11:49
Kevin Fang
Рет қаралды 1 МЛН
Files & File Systems: Crash Course Computer Science #20
12:03
CrashCourse
Рет қаралды 758 М.
The Circle of Unfixable Security Issues
22:13
LiveOverflow
Рет қаралды 114 М.
Harder Drive: Hard drives we didn't want or need
36:47
suckerpinch
Рет қаралды 1,7 МЛН
This Insane Virus Trick Would Have Fooled Me - Watch Out!
7:53
Hacker Tweets Explained
13:47
LiveOverflow
Рет қаралды 159 М.
Players vs Corner Flags 🤯
00:28
LE FOOT EN VIDÉO
Рет қаралды 70 МЛН