An Interesting Redirection Bug. How Redirection Can Change Program Behavior.

  Рет қаралды 11,578

Jacob Sorber

Jacob Sorber

Күн бұрын

Пікірлер: 55
@unperrier5998
@unperrier5998 2 жыл бұрын
Nice bug to demonstrate. And it's nice to be able to redirect directly from gdb as well. Thanks!
@lean.drocalil
@lean.drocalil 2 жыл бұрын
There's always highly valuable stuff from this channel. Again, this is spot on👌
@JacobSorber
@JacobSorber 2 жыл бұрын
Thanks, Leandro.
@ranchu3203
@ranchu3203 2 жыл бұрын
I didn't expect this. So basically, if I am understanding this right, the OS trying to "optimize" with more data being buffered leads to the segfault. Interesting. Oh well you learn new things every day. Great video
@MarekKnapek
@MarekKnapek 2 жыл бұрын
Not the OS, but the C language run-time.
@hashinggz
@hashinggz Жыл бұрын
stderr is not buffered, and back in the day when I learned about it, big deal, performance. Now I know. thank you again!
@peterg76yt
@peterg76yt Жыл бұрын
The bug is the bug you deliberately wrote in the fake allocation routine. Redirection is working exactly the way it's supposed to. I'm pretty sure I remember that in the documentation on the standard file descriptors.
@neerajkale
@neerajkale 2 жыл бұрын
At the start of the video I assumed the seg fault has something to do with "> out.txt" been treated as 2 arguments to the program in argv[] 😅😅😅😅 As usual learnt something new again from this channel. 😇
@andrewnorris5415
@andrewnorris5415 2 жыл бұрын
Like an airline pilot practices checklists in simulators for when things go wrong. So we should practice debugging skills. You never know when they might be needed and would save a ton of time when we need it most and make meeting critical deadlines possible.
@andrewnorris5415
@andrewnorris5415 2 жыл бұрын
Imagine if a critical random bug appears in released code. Would fix it much quicker and with fewer headaches than if all your skills were was print debugging.
@KevinInPhoenix
@KevinInPhoenix 2 жыл бұрын
If you write a custom memory allocator and don't test it with small and large values then you are not done yet. Inadequate testing is the root of all evil.
@fburton8
@fburton8 2 жыл бұрын
And zero and negative memory sizes and different sequences of allocations and... Something as low-level as a custom memory allocator needs to be tested up the wazoo (unless you don't mind random seg faults and futzing around with gdb).
@unperrier5998
@unperrier5998 2 жыл бұрын
I thought it was premature optimization that was the root of all evils. Maybe things have changed :)
@JacobSorber
@JacobSorber 2 жыл бұрын
So many roots of all the evils. :)
@Takyodor2
@Takyodor2 2 жыл бұрын
@@JacobSorber All -roads- roots lead to -Rome- evil!
@razu1976
@razu1976 2 жыл бұрын
This is a lesson dressed up as related to redirection, but is in fact SUSPECT ANY DIFFERENCE when things go a bit weird 😅 Cool drill-down to the details 👍👍👍
@reptilicusrex4748
@reptilicusrex4748 2 жыл бұрын
Thanks, very interesting and learned a couple gdb features as well.
@SourabhBhat
@SourabhBhat 2 жыл бұрын
How does the program know that its std output will be redirected by the OS? That seems a bit strange! I thought redirection is done by the OS or the terminal.
@mikes9016
@mikes9016 2 жыл бұрын
Good question, I wonder as well.
@JacobSorber
@JacobSorber 2 жыл бұрын
Honestly, I don't know. Never dug that deep. But, now, of course, I need to find out. If the answer is interesting, then maybe it'll show up in a future video.
@mikes9016
@mikes9016 2 жыл бұрын
@@JacobSorber thanks 👍
@csbnikhil
@csbnikhil 2 жыл бұрын
A nitpick. A terminal has nothing to do with this. It just renders text on the screen. What you probably meant was a shell.
@tacokoneko
@tacokoneko 2 жыл бұрын
i think the program has undefined behavior so until it executes it is in a superposition state where it could either work perfectly or do something completely random and the decisions the operating system makes about where to allocate memory for the program at the moment it is called are having an effect on this balance. so in brief i think the operating system is influencing whether the segfault occurs not the program itself, the program is only providing the undefined behavior
@edgeeffect
@edgeeffect 2 жыл бұрын
That's fascinating.... a bug that "can't possibly exist".
@rkroshan1997
@rkroshan1997 2 жыл бұрын
Awesome learning
@will_i_craft5555
@will_i_craft5555 2 жыл бұрын
I’ve seen that curl changes it’s behavior when redirecting (printing progress to stderr). Is it detected with a similar behavior there?
@kebien6020
@kebien6020 2 жыл бұрын
It probably uses isatty(3)
@HansBezemer
@HansBezemer 2 жыл бұрын
Never knew that! But I can fully imagine you were scratching your head when seeing this behavior with your own eyes!
@JacobSorber
@JacobSorber 2 жыл бұрын
Yeah, it definitely took a few moments.
@benjaminshinar9509
@benjaminshinar9509 2 жыл бұрын
how did you make the program use the custom allocator? can you share the compile/link command from the makefile?
@JacobSorber
@JacobSorber 2 жыл бұрын
Just link the function in with the program. Either include it in your .c file, or compile it in a separate .o file and then link them together. It will use your malloc first before looking for one in libC. And, of course, you can do this at runtime using a shim, as well.
@tacokoneko
@tacokoneko 2 жыл бұрын
i have arch linux with kernel 5.16 and the program behaves exactly the same on my system, i was also unable to find any arguments for gcc or clang that could change the result. however i wonder if it is possible to create an environment where the program always segfaults or never segfaults, or segfaults without redirection some of the time but not all of the time
@adrianojordao4634
@adrianojordao4634 2 жыл бұрын
Probably there is a vdu that explains the need to do custom alocators. I fully respect your programing skils, but this i miss. And wy 1k alocation is enauff?? Very cool but i feel that i m missing the point. Cheers
@genz01234
@genz01234 2 жыл бұрын
Nice Practice. Although the bug is created by self(customized allocator).😂 It's good to know "redirect" will also use malloc() to create a buffer for output.
@wojcieszekk8581
@wojcieszekk8581 2 жыл бұрын
I wonder what functions did your students use? If have written an allocator for my operating system classes and i used sbrk. Is it better to use mmap or sbrk?
@BoundedByte
@BoundedByte 2 жыл бұрын
Just commenting in here so I can learn too-I usually wouldn’t use mmap for this sort of thing. I prefer it for buffering very large file I/O, whereas sbrk is appropriate for custom allocators since that’s usually what malloc is going to actually use in the first place. But if those assumptions are flawed or wrong I’d love to be corrected
@wojcieszekk8581
@wojcieszekk8581 2 жыл бұрын
@@BoundedByte I saw mmap implementations and I was just curious what is Jacob's recommendation for this. My requirement was to use standard sbrk. I was wondering what are the differences and what are his requirements for students and how different are my classes compared to his 😀
@JacobSorber
@JacobSorber 2 жыл бұрын
I don't know that it really matters. I often have my students use mmap, because then it doesn't interfere with the built-in allocator (which uses sbrk). But, you can definitely use either. Both are just mapping memory for you.
@wojcieszekk8581
@wojcieszekk8581 2 жыл бұрын
@@JacobSorber Thank you 🤎
@i007c
@i007c Жыл бұрын
make your intro 5s so when we seek once its complitly seeks the intro
@ghostfjdgcsusvsgsj
@ghostfjdgcsusvsgsj 2 жыл бұрын
Never knew Mathew McConaughey could teach programming...
@YannAriell
@YannAriell 2 жыл бұрын
Nice video , but , how to include a function c++ in c
@yellowkll2853
@yellowkll2853 2 жыл бұрын
write a wrapper
@YannAriell
@YannAriell 2 жыл бұрын
@@yellowkll2853 Yeah but he dsn't work
@yellowkll2853
@yellowkll2853 2 жыл бұрын
@@YannAriell do you know how to compile source files into object files, and then link the object files together?
@YannAriell
@YannAriell 2 жыл бұрын
@@yellowkll2853 not too much but I know how to include C files in cpp
@yellowkll2853
@yellowkll2853 2 жыл бұрын
@@YannAriell kzbin.info/www/bejne/aIrJfmB-rbaXlZo
@alexisrodriguez7127
@alexisrodriguez7127 2 жыл бұрын
Wow super cool and weird
How Does LibC Detect Redirection? Interesting Bug Follow Up.
8:02
Jacob Sorber
Рет қаралды 10 М.
One reason to Modify your Memory Allocator (C/C++)
10:23
Jacob Sorber
Рет қаралды 34 М.
It’s all not real
00:15
V.A. show / Магика
Рет қаралды 20 МЛН
Сестра обхитрила!
00:17
Victoria Portfolio
Рет қаралды 958 М.
Une nouvelle voiture pour Noël 🥹
00:28
Nicocapone
Рет қаралды 9 МЛН
How do I access a single bit?
11:07
Jacob Sorber
Рет қаралды 22 М.
Can I Handle Exceptions with Try Catch in C? (setjmp, longjmp)
11:13
The Most Useless Keyword in C?
10:26
Jacob Sorber
Рет қаралды 69 М.
Defining Constants. Should I use CONST or #DEFINE?
7:59
Jacob Sorber
Рет қаралды 58 М.
How does fork work with open files?
13:12
Jacob Sorber
Рет қаралды 10 М.
Pulling Back the Curtain on the Heap
21:38
Jacob Sorber
Рет қаралды 37 М.
How Memory Usage Slows Down Your Programs
9:17
Jacob Sorber
Рет қаралды 19 М.
Cursor - 4 minute demo  - AI Code Editor
3:39
Greg Baugues
Рет қаралды 1,9 М.
The Call Stack and Stack Overflows (example in C)
12:56
Jacob Sorber
Рет қаралды 47 М.