Modernize your Linux Storage with btrfs!

  Рет қаралды 157,204

Learn Linux TV

Learn Linux TV

Күн бұрын

Пікірлер
@duser
@duser 2 жыл бұрын
Please do make more videos on btrfs! especially on things like snapper, best practices, tricks with the file system that may be useful.
@LampJustin
@LampJustin 2 жыл бұрын
As to best practices go RAID 1 or 10 or Single if you don't need raid. If you can duplicate your metadata 3 times (RAID1(0)c3) Do a srub every month or two, doesn't need to be often and after that do a btrfs balance. That's pretty much all. Tips: Use reflink copies whenever possible (cp --reflink always) It will create copy without physically copying the data. Only the new metadata will be created, similar to sym/hard links. It just doesn't come with any of the drawbacks. It's like dedpulication and can be used like that. ;)
@duser
@duser 2 жыл бұрын
@@LampJustin Thank you! I heard about reflinks but never really have an application for them at the moment. Oh and that raid setup 100%!
@LampJustin
@LampJustin 2 жыл бұрын
@@duser yeah it's really useful for dealing with VMs, cloning them with that flag is pretty nice and safes not only time but space as well. Good thing is that latest gnutils set the --reflink auto by default. So whenever you copy stuff it will get reflinked. Nautilus on Gnome also does the same
@sexualsmile
@sexualsmile 2 жыл бұрын
kzbin.infoPF77M2V0UYs?feature=share
@toast1797
@toast1797 2 жыл бұрын
I can't believe you released a video about btrfs at the exact moment I wanted to know more about it!
@logyross6883
@logyross6883 2 жыл бұрын
lol same, I literally searched it yesterday
@techboy007Bond
@techboy007Bond 2 жыл бұрын
I can't believe it's not butter
@rahilarious
@rahilarious 2 жыл бұрын
same... I am planning to migrate my ext4 gentoo to btrfs since a while but been lazy to research bout btrfs. but now Jay solved it
@tactileslut
@tactileslut Жыл бұрын
Mmm, toast. Now with butter!
@paulthompson1988
@paulthompson1988 2 жыл бұрын
As usual, a very well researched and well-presented video from you. Good balanced overview of BTRFS, with the pros and cons, and where to looks for updates on that. It is great that a modern file system is being actively developed, and glad you highlighted it. Thanks Jay.
@Rood67
@Rood67 5 ай бұрын
I'm late to the party, but here are a few things: 1. When taking a snapshot of a location that has a snapshot, are you not adding that existing snapshot into the new snapshot? Or is BTRFS smart enough to exclude snapshots? 2. Yes, please make more BTRFS videos 3. Please make BTRFS related videos with TimeShift, BackInTime, and Snapper as the focus 4. Please make a BTRFS video focusing on btrfs send | btrfs receive
@TheGraemi
@TheGraemi Ай бұрын
1. BTRFS excludes own subvolumes. And snapshots are a special form of a subvolume.
@pierrecassidy583
@pierrecassidy583 Жыл бұрын
I'd certainly love to see more btrfs content. Thanks for all the great work!
@LearnLinuxTV
@LearnLinuxTV Жыл бұрын
I’ll consider doing more
@act.13.41
@act.13.41 2 жыл бұрын
I am all for more BTRFS videos. I have been learning a lot from your channel. Thank you sir.
@thedavymac
@thedavymac 2 жыл бұрын
Bro, I’m a little high right now so my sense of time is a little warped and it makes me pay much closer attention to your voice tones, and let me tell you… you have gotten a shit load better my brother. Much props on the high quality effort on the script and prep work you did. You really took the time to explain nuance. I have bookmarked this to rewatch while not high lol
@kendawg_mcawesome
@kendawg_mcawesome Ай бұрын
When it comes to btrfs, you are producing the best content available. Great stuff.
@michalisfotiadis4966
@michalisfotiadis4966 2 жыл бұрын
My top btrfs configuration options on Arch: Create a subvolume at /home, /tmp, /var/log, /var/cache, /var/lib/flatpak, /var/lib/libvirt, /srv, /root, /opt, /usr/local and of course /.snapshots, also ideally you want to replace the root subvolume so I create another one and mount it at /. For mount options: noatime,compress=zstd,discard=async,space_cache=v2,ssd_spread. Disable CoW for /var/lib/libvirt for better performance. And most importantly, even if you take snapshots of your root subvolume, you won't be able to boot, so I have a pacman hook that triggers every time I upgrade my kernel, which runs rsync -a --delete /boot /.bootbackup. Small tip is to also delete the subvolid from fstab (it's not needed, subvol is enough) so you can easily restore a subvolume.
@LampJustin
@LampJustin 2 жыл бұрын
Yeah good recommends! But for me those would be too many subvols to keep track of and snapshot. I just have @ @home and libvirt images of course. I really don't like the naming but that's what you need for Timeshift........ Also yes you really shouldn't use subvolids in fstab or anywhere. Just renaming the subvols to rollback is a must.
@michalisfotiadis4966
@michalisfotiadis4966 2 жыл бұрын
The most optimal defaults differ form usecase to usecase. However it would be nice for fedora to step up their btrfs game, as it comes by default, the current one is an extremely vanilla setup and definitely less than ideal.
@superspectator123
@superspectator123 2 жыл бұрын
Great video! Thank you! And yes, I would like to see more advanced concepts of btrfs in future videos.
@smoetje
@smoetje 2 жыл бұрын
My Synology is using BTRFS for about 4 years now in a SHR raid. Its working like a charm and even disk replacement and raid rebuild, went flawless. Stable, stellar performance and deduplication is an awesome feature.
@LucS0042
@LucS0042 2 жыл бұрын
It's only really RAID 5/6 (stripping) that is not completely stable with BTRFS. Actually, it's implementation of RAID1 is one of the best things about BTRFS for desktop computers in my opinion. Having installed an OS on two disks using RAID0, I was able to on-the-fly, without rebooting, in a matter of seconds, switch to RAID1. Something even the mighty zfs can't do for now (changing vdev structure).
@PeterKese
@PeterKese 2 жыл бұрын
This! RAID 0 and RAID 1 are perfectly fine and work even better than md-raid. It's just RAID 5/6 that are incomplete (although errors are extremely rare with proper use - similar guarantees as md-raid on Linux kernels prior to 4.4).
@williamp6800
@williamp6800 2 жыл бұрын
If RAID 5/6 had never been released, the BTRFS story would be really simple: “It’s a very reliable, flexible, and full feature modern file system for the desktop, and and anywhere else you don’t need big pools of disks.” As a bit of a ZFS zealot, I have to say BTRFS is really good.
@danbrown586
@danbrown586 2 жыл бұрын
"Something even the mighty zfs can't do for now (changing vdev structure)" Nonsense. ZFS can easily add/remove disks from stripes, and add mirrors to those disks--i.e., do exactly what you described that you did. But parity RAID vdevs can't (currently) be changed; that's been Coming Soon™ for a number of years.
@LucS0042
@LucS0042 2 жыл бұрын
@@danbrown586 are you saying ZFS can take a two disk stripe vdev and convert it to mirror vdev on the fly and back to stripe?
@danbrown586
@danbrown586 2 жыл бұрын
@@LucS0042 Well, there's no such thing as a "two disk stripe vdev"; that would be two single-disk vdevs striped together. But with that caveat, it seems a strange thing to want to do, but yes, ZFS can do it.
@LampJustin
@LampJustin 2 жыл бұрын
10:12 No you absolutely should use RAID with BTRFS, just not R5 or 6. RAID 1 and 10 are much superior to mdraid or hw raid. Just striped RAID setups suffer from write holes if you're not careful.
@LampJustin
@LampJustin Жыл бұрын
@@squishy-tomato fair, but I just wanted make it clear that RAID1(0) is indeed stable and totally usable. I already have some corruption from time to time, because of a bad controller. BTRFS does it's job great and corrects those flipped bits just fine. And yes I should definitely swap the controller, but cannot right now...
@NilsNormann
@NilsNormann 2 жыл бұрын
Thanks!
@HaroldPearson
@HaroldPearson 2 жыл бұрын
Thoroughly enjoyed this video. Thanks for making content like this, Jay. I would love to see more content on the advanced features of btrfs.
@yadsarwat6325
@yadsarwat6325 2 жыл бұрын
thanks for the great video, btu I am curious what is the difference between ZFS and Btrfs, which one do you prefer?
@Knirin
@Knirin 2 жыл бұрын
ZFS, Btrfs losses data if you use anything but single drive, mirror, or stripe mode.
@joseffistus3058
@joseffistus3058 2 жыл бұрын
A really good video about btrfs. btrfs is a great FS. I use it since 2012. Never had any problems with btrfs. N8ever used Raid5/6 - only the so called "RAID1". Maybe that is why I never run into any problems...) One of the best features is to do read only snapshots of our home directory and use them for making backups via send / receive to another btrfs device. (It took me some time to understand the construct of send / receive - but finally it works :)
@mlongval
@mlongval 2 жыл бұрын
Excellent video Jay. Thank you very much. I have looked at BTRFS for a while, but never dove into it. Going to try it in a VM tonight. Please more videos on the subject. Also have you done videos on "backup best practices?" I would very much enjoy watching that. Thanks and Cheers from Canada!
@FengLengshun
@FengLengshun 2 жыл бұрын
I found btrfs due to Fedora and Garuda. I love how Garuda implemented snapper, was very helpful when I was more experimental and overall just give me peace of mind. With Steam recently supporting CoW, would it be worth it to have my game partition as btrfs?
@gnul
@gnul 2 жыл бұрын
I write too long stuff. TL;DR: Yes. I use it now for few years for hundreds of games spanning over 3.5TB, btrfs just works. I use @games subvolume, mounted at /mnt/games. I use and recommend Steam flatpak, fully sandboxed (all access to my files revoked), gave access to /mnt/games:rw (read write permissions from flatpak), just works. And it can’t mess with my personal files at all. btrfs is the successor of ext4, it basically can do over 99% of what ext4 can do, but much more at same, little worse, or even better performance. Of course they are extremely different fs, but for end user, I can’t say anything other than it just works. When paired with ECC RAM. But if not having ECC RAM, the other fs suffer the same, but they don’t tell you. Btrfs on the other hand knows e.g. when your file integrity is broken. But btrfs trusts the CPU and the RAM, so it will tell you your disk is broken or that cosmic microwave background radiation hit your NAND cell and broke some data on the disk, it won’t tell you data read is correct, but the one in the RAM is faulty, it does not know that, it thinks errors detected are from the disk. It assumes your CPU and RAM do not lie. When using btrfs raid 1 or 10 (with data copy) it periodically checks file integrity automatically, cause it hashes or checksums each file (always, that’s how it detects errors), if it detects mismatch, it will automatically check the other disk and repair broken data automatically, cause it knows if something is broken, and in RAID 1 case has a fully functioning copy. So awesome for system and documents and so on. If you don’t care about games integrity you can just ignore that feature, but it is still a good fs. You can use snapshotting, e.g. when modding a game, when an update broke your game mods, you can then look into snapshot and restore stuff or whatever. Only limitation is your imagination. It is better than ext4, allows resizing, and whole lot more features, comparable to zfs,.. so of course it is a good option. It is also newer than zfs, in my view it is better than zfs, but it depends. E.g. BSD NAS should use zfs. But for desktop, or server, always btrfs. But still, ext4 is good filesystem as well, as well as xfs, they are good choice as well. For games it does not matter that much. I recommend for system and home, two NVMe SSD, e.g. Micron 7400 Pro with power loss protection, using dm-crypt / luks on them, on top of that btrfs (in RAID 1 fully copy mode), and ECC RAM. Then maybe unencrypted additional SSD, e.g. FireCuda 530, btrfs for games. ECC RAM is no bottleneck in gaming. I just ‚downgraded‘ speed, from 64kMiB 3.6GT/s cl16-19-19-19 to 128kMiB 3.2GT/s cl22-22-22 ECC RAM - literally no difference in FPS (I play at 4k). If you have stutter in CSGO, right click, properties, compatibility, choose Steam Linux Runtime, working in Flatpak as well, they made it compatible, sandboxing works with native performance.
@TheRealFaceyNeck
@TheRealFaceyNeck 2 жыл бұрын
This video helped me understand BTRFS better. Great work! ...also Snapper is great. I set it up following a different KZbin video. It's awesome for people who want snapshots to be automated. It's in the RPM repos. (I'm also using Fedora.)
@mikes.9091
@mikes.9091 9 ай бұрын
Thank you for the information on BTRFS. I'm a new Linux user and i'm watching\learning as much as I can about all the various aspects of Linux.
@ytuser13082011
@ytuser13082011 2 жыл бұрын
BTRFS is awesome and it's much lighter than ZFS. I worked as a storage engineer for ~7 years and that's what I've learned during tons of tests and implementations - you DON'T need ZFS and BTRFS is really highly usable these days.
@Julian-sj5tr
@Julian-sj5tr 2 жыл бұрын
I used BTRFS for @, @home, and @data subvol. I do dual boot Ubuntu with windows. With BTRFS it can share file directly with WinBTRFS. My laptop small SSD can fit much of data with it's compression. Some game like DotA 2 compressed at almost 50% ratio. I install all my program at BTRFS, also set my fav folder like download, document to @data subvol. Data deduplication also work in Windows. That is very much better integration than old school ext4.
@TheGeorey
@TheGeorey Жыл бұрын
​@@Julian-sj5tr compressing Dota 2 doesn't hurt performance? (fps)
@vishaltripathy3620
@vishaltripathy3620 Жыл бұрын
@@TheGeoreyexactly my thought
@neilbedwell7763
@neilbedwell7763 2 жыл бұрын
As far as I could tell from every other source, the BTRFS 'raid likes' are all fine and commonly used as defaults EXCEPT for raid5/6 implementations. But please do look at multiple closer-to-official accounts of btrfs raid profiles
@Knirin
@Knirin 2 жыл бұрын
Anything other than pure RAID 1 or RAID 0 will eat data and will probably never be implemented correctly.
@Winnetou17
@Winnetou17 2 жыл бұрын
Can I be THAT guy ? Why doesn't btrfs integrate with df and du ? Not having to learn a slew of new commands for each fs would be, oh, so neat. Also, how is performance, when using subvolumes and quotas and such ? Is it just a couple percent slower in heavy duty (big listings, logs writing, file retrievals by a server etc all at the same time) ? Or it's more than that ?
@jescis
@jescis Ай бұрын
Garuda Linux defaults to BTRFS as well… but I'm not sure of when OpenSUSE 36 came out as opposed to Garuda Linux and BTRFS and when your video was released… 🤔🤔🤔🤔 41:40 you say not to use df -h, but what about lsblk or blkid programs?? Do you HAVE to use the BTRFS program??
@EthanLR
@EthanLR 2 жыл бұрын
34:21 but going forward everytime you reboot you land back on that same snapshot. is the current state of the filesystem the snapshot, or is the filesystem now read-only?
@CGA111
@CGA111 2 жыл бұрын
Finally, someone who managed to explain subvolumes in a way even my feeble mind could comprehend.
@vegar1tube
@vegar1tube 11 ай бұрын
Love the content 👍🏼! Yes, kindly provide a refresh on BTRFS and it's applications such as for virtualization (proxmox,etc,.), improvements, practical uses and such. Apparently, some of the major tech giants use it in their environment and it's natively supported in the Linux kernel.
@macedoplinio
@macedoplinio Жыл бұрын
The best tutorial I have ever seem!! Congratulations!!!!
@trubadyr99
@trubadyr99 2 жыл бұрын
I would elaborate more about the benefits, purpose, and compelling reasons why an average user might need to use BTRS. A person has to be motivated enough to use or even try it. Because managing it, especially without the possibility of using GUI, looks pretty complex to the average home user.
@WildMidwest1
@WildMidwest1 2 жыл бұрын
He hinted GUI end use it when he mentioned TimeShift but he did not go into it. I agree with you that the average Linux beginner (myself for example) is not going to want to modify fstab files manually or run all these command lines.
@melaniezette886
@melaniezette886 Жыл бұрын
I think Suse has developed a GUI.
@MarkWatsonSMTX
@MarkWatsonSMTX 2 жыл бұрын
It sounds like btrfs is easier to implement that LVM. It would be nice to see a detailed comparison with use cases for both.
@AndersJackson
@AndersJackson 2 жыл бұрын
LVM is easier to implement then btrfs. It is probably easier to use btrfs, but LVM is easier to implement, and then you just add ordinary file systems on top of LVM. But btrfs is combination of LVM and a modern fs. But it is actually another implementation based on ZFS, which is better then btrfs, as it is older and design by people that actually knows how to run huge servers. That said, btrfs features are not bad, and a bit lighter then ZFS. So all features in btrfs is in ZFS, but not everything in ZFS is implemented in btrfs (like RAID etc).
@wassim-akkari
@wassim-akkari 2 жыл бұрын
@@AndersJackson there is RAID in btrfs
@angelvega2652
@angelvega2652 2 жыл бұрын
LVM and btrfs are not for the same purpose. The first is a system for managing physical or logical volumes and disks but sencond is a file system. We can user btrfs in out LVM logical volumes.
@ericfielding668
@ericfielding668 2 жыл бұрын
Thanks - I learned a bunch We have BTRFS running on a Synology NAS but EXT3 / EXT4 / ZFS everywhere else. It was good to hear a bit on how BTRFS works.
@xellaz
@xellaz 2 жыл бұрын
Great video! I'm always interested in filesystems and ways how to manage it. It would be awesome to have a video on what are the optimal ways of managing a btrfs filesystems checking for errors, repairing, etc. I have btrfs on my main Linux machine and also on my NAS. I'm always on the lookout for best practices on how to secure my data.. especially when it comes to the filesystems I'm using which is btrfs. 😅
@BuBa-hm9kk
@BuBa-hm9kk 8 ай бұрын
Thanks Sensei ! 25:23 if I understand correctly, you're saying that : "despite BTRFS subvolumes being stretchable, without its quotas feature, the system becomes unusable when every bit of subvolume freespace becomes redistributed/saturated (e.g because of a logfile out of control). And since as of 2024 the quotas feature is still not ready, BTRFS on LVM appears mandatory/convenient for : hot-resizing/hot-bay-expanding/hot-bay-removal/insertion in a LVM rig. BTRFS itself seems enough for partitioning/isolating into subvolumes, but without LVM, users have to know beforehands the allocated storage sizes." So now I wonder why I saw nobody on YT putting up a guide on such way of installing (e.g for a Debian install + switch to busybox in the process) : efi + boot + PV, then on PV, a LV for root and a LV for home at least. BTRFS with subvolumes on LV root, BTRFS or EXT4 for LV home. Snapper integration able to snapshot only few subs from LV root, as well as LV home. (Optionally, LUKS sandwiched on LVM and under BTRFS would be the cherry on the top. So far, only skai nyght made it this way on YT. But him and EF (both Arch guys) encrypt swap in a way that prevents hibernation, so unconvenient for nomad laptops...) Maybe I'm missing some content, i don't know, otherwise feel free to hand out the idea to Tom if you already scheduled bunch of other content already ! :)
@DjBloodsaw
@DjBloodsaw 2 жыл бұрын
A lot of arch distros use BTRFS by default, that's how I found out about it. The snapshot feature has saved me from quite a few mishaps.
@electricflyer81
@electricflyer81 2 жыл бұрын
Yes, please provide additional content on btrfs. Thanks!
@musefirefox2420
@musefirefox2420 2 жыл бұрын
Is there any validity in btrfs reducing the lifespan of SSDs? Great video! Thanks
@anthonywalker6268
@anthonywalker6268 Ай бұрын
Problem, I'm looking for a file system for my backups.
@jescis
@jescis Ай бұрын
I have a separate HDD for personal data and backups(the drive is 8TB, but I'm only using ~855GB+… so because I want to stay strictly Linux and I'm researching to know if I can use ext4 or btrfs or something else… 🤔🤔🤔🤔
@raykall
@raykall 6 ай бұрын
This was so great and so informative. Thank you very much!
@uncrunch398
@uncrunch398 8 ай бұрын
I'm just curious how much space savings I can get switching from ext4 and using the tightest compression available. Still all good to learn if interested in this FS though.
@jensenjs
@jensenjs 2 жыл бұрын
First, sorry for my poor English, i'm slightly dyslectic... The only reason I still have 2 Windows computers, is a program called RollbackRx. I have heard/read about BTRFS, and wondered if the works the same way as Rollback Rx And your GREAT video, shows me, it is almost the same idea and same functions, though all from the terminal. Thanks for showing some of this functions. -------------------------- I have for several years used RollbackRx. for Windows I bought 5 Pro licenses years ago and over time updatet to new edtions. As I wrote I have only 2 Windows computers today, and Rollback are the main reason. But I have had an eye on BTRFS for some time, but has been unsecure, since the sometimes negative critics. With your video here, I can se that most of the reputation is mainly a userproblem. (no critics to BTRFS from me, it is complicated, but not impossible.)
@АндрейИвшин-ф4г
@АндрейИвшин-ф4г Жыл бұрын
Спасибо за урок! Всё что нужно по btrfs. Не чего лишнего, только самое нужное. Отличное видео.
@notreallyme425
@notreallyme425 2 жыл бұрын
10:30 you mention not using RAID with BTRFS. I have a Synology NAS using a BTRFS volume. Is that a RAID system using BTRFS vs BTRFS using RAID?
@SebastianPerezG
@SebastianPerezG 2 жыл бұрын
When fedora switches to btrfs from LVM ? it was a pain in the ass when you create a next next installation and they give you only 2gb for his root or system partition .
@mmaster23
@mmaster23 6 ай бұрын
When you say don't do raid, do you mean don't do parity raid or also no mirroring as well?
@minifig404
@minifig404 2 жыл бұрын
Would love to learn more about what Fedora 36 does or doesn't do out of the box to protect your data. It's kinda important to know whether scrubbing and automatic snapshots are your responsibility or not.
@NS-no1li
@NS-no1li 2 жыл бұрын
I was wandering what happened BTRFS .. it in fact has been around for decades and every now and again it raises its head and comes to the fore front with new features. I remember it back in SMS days when I worked there.. where is was played around in UNIX on Solaris. I have always liked the BTRFS concept and idea of use and I an happy to see it once again come to the fore front as commercially viable filesystem. Thank you for your introduction and viewing. I personally would like to see more about it and where it is going currently.
@George.Gadgets
@George.Gadgets Жыл бұрын
Question: if I have a btrfs partition (fedora 38 default) which includes / and /home as subvolumes, is a / snapshot supposed to include the /home data as snapshot? It is, if you make an snapshot of / and a snapshot of /home, aren't you duplicating the /home data snapshot? As a second question: is it smart to make a / (root) snapshot? If so, the snapshot will also contain the data in all the folders including folders from other filesystems like /boot? Thanks in advance.
@0eieiei
@0eieiei 2 жыл бұрын
Another banger. Thanks, Jay!
@criandoEdesenvolvendo
@criandoEdesenvolvendo 2 жыл бұрын
Cheers from Beazil. Thank you for this useful video
@magoostus
@magoostus 2 жыл бұрын
so BTRFS raid1 and raid10 are stable, so the work-around we've been doing is to make *metadata* raid1 or raid1c3 and have the data as raid5 or raid6 which solved the potential corruption issue.
@Royaleah
@Royaleah 2 жыл бұрын
I have ran btrfs on a raid1 style for a while. It had been reliable and easy to work with, but I have noticed increase and decrease in performance when I go to new kernels.
@Traumatree
@Traumatree 2 жыл бұрын
Btrfs WAS unstable hence the reputation it got and why no one wanted to use it. With ZFS around though, I don't really get why we would even use btrfs as the former has been tested and is production ready since the last decade, a thing btrfs can't claim yet. It is a nice project, but again re-inventing the wheel when there was a solution already (ZFS).
@bertnijhof5413
@bertnijhof5413 2 жыл бұрын
The problem with btrfs is a bad architecture. Basically it stores the data belonging to the not existing volume object with the first physical disk of the volume. That is basically a beginner's fault and one of the reasons Red Hat stopped using btrfs. With this type of mixing objects, it will always be difficult to maintain a reliable system. Personally I only use btrfs in simple configurations. I have used btrfs with Peppermint 10 in Raid-0 on a Pentium 4 HT with IDE HDDs and I was happy with the results. The system booted in ~45 seconds. The free storage was very confusing and basically BS. I have used it too in my VMs like Fedora, but nowadays I install Fedora on ext4. That is not the fault of btrfs, but of the way I use VMs. Once per week I zero out the not used space to save space on my Host running OpenZFS (lz4 compressed). Zeroing out a compressed btrfs or OpenZFS on a compressed virtual disk of a VM takes close to an infinitive time. That is why I install my VMs always on ext4 :) Personally I prefer OpenZFS, the system has originally been designed by Sun Micro-system and it has a great architecture without the btrfs architectural blunder. Also the command line interface of ZFS is superior to that of btrfs. I have the feeling that ZFS is blocked by some companies for inclusion in the Linux kernel using the excuse of license issues. These license issues are just an excuse to block ZFS, since Ubuntu has integrated ZFS in Ubuntu since 16.04 and nobody sued Canonical. The same is true for many server systems like Proxmox; TrueNAS etc.
@wyfyj
@wyfyj 2 жыл бұрын
In love with the meme usage
@maksimmuruev423
@maksimmuruev423 11 ай бұрын
So btrfs required linux kernel on separated ext4 partition? I've got all on btrfs..and belive this is the cause of the issues with attemp to restore from the snapshots.. but who knows.
@shaddow1dog
@shaddow1dog 2 жыл бұрын
btrfs goes back many years ago. It was first used as a file manager for an accounting package. It has had an up and down history. One of the issues was once you used one application with btrfs you can not use another app using btrfs. It was a very popular file system many years ago and has reinvented itself and it's popularity thanks to Linux.
@andreadiaz2867
@andreadiaz2867 2 жыл бұрын
This is really great and very helpful. Thank you for sharing.
@dannylight2expose818
@dannylight2expose818 2 жыл бұрын
Synology is using btrfs in many of their systems. I would suppose they know what they are doing?
@smoetje
@smoetje 2 жыл бұрын
It's working like a charm. Mine already does for about 4 years.
@melaniezette886
@melaniezette886 Жыл бұрын
I use it for years on my very old laptop. Very satisfied, snapshots are great. And you can do things you can't with other fs even we have to be carefull
@melaniezette886
@melaniezette886 Жыл бұрын
Yes btrfs is not raid
@Ruddy761
@Ruddy761 2 жыл бұрын
I am installing a new ver of Fedora and am trying to decide if I want to use btrfs or stick to ext4. It will be a single disk graphics workstation (blender, gimp, etc), I ll be working with mostly large files. What you think?
@muddyexport5639
@muddyexport5639 2 жыл бұрын
Good info/vid! What about migrating an EXT4 to BTRFS? In-place utilities or copy/add/delete/adjust from one to the other. I guess the question might also be BRTRS to EXT4? Never seen that topic or topics addressed but I haven't researched to any extent -- link to existing process? I remember doing these file system changes on IBM propertary OS but I didn't operate in the Unix/Linux OS environment. Blown long 3 day holiday weekend process counting full backup, execution, backup to new file system schema.
@onditireagan6194
@onditireagan6194 Жыл бұрын
Thanks for such a wonderful video on btrfs,have a problem with my proxmox server running btrfs, its generating an error when starting the server,how do one rescue the btrfs file system
@zachsandvik1867
@zachsandvik1867 Жыл бұрын
Top, Jay! Thanks for your explanation! :-)
@igorminaev7017
@igorminaev7017 2 жыл бұрын
Thank you, it's very useful! But for me (as a btrfs newbe) would be very important to see how to create subvolumes (the process of installation OS with btrfs). I'm still using ext4 ( because ,in my case, I know how to create ext4 partitions: / on SSD + /home on HDD ). In case with btrfs still can't understand it (
@Cadambank
@Cadambank Жыл бұрын
This video tells about creating subvolume during installation. I don't know if this helps. kzbin.info/aero/PLwQD7rvZhbK-L6JlQwqOSP3DvMUmvbPvj
@muddyexport5639
@muddyexport5639 2 жыл бұрын
Yes, please more BTRFS vids!
@ruimagro72
@ruimagro72 2 жыл бұрын
Butter FS!!!!! Where is the Toasted Bread?????? Served with an FS on the side?
@sykoteddy
@sykoteddy Жыл бұрын
I've only watched half of the video but will continue tomorrow. I just wanned to thank you so much for making such in deepth videos for numbnuts like me. I don't know why I have such hard time grasping how Linux is built, but I wished I would have migrated to Linux from Windows a long time ago, then it probably would have been a lot easier. 🙏👌 I created my btrfs partitions while installing EndeavourOS but it seems like they are partitions and not subvolumes because my home partition and root doesn't share the same size. Can I reconfigure this afterwards or do I need to do it before I install EndeavourOS next time? I had devided a 960GB NVMe into 512mb fat32, 40Gb for / and the rest for home. Would be greatful if you give me a smallexplanation. Thx alot for a great Channel!
@nemonada3501
@nemonada3501 2 жыл бұрын
Definitely want to see more about this topic.
@rafal9ck817
@rafal9ck817 2 жыл бұрын
29:00 Why not readonly snap? Then it's easier to just snap snap (btrfs sub snap -r org backup ; echo 'breaksystem' ; btrfs sub snap backup org).
@JahidulIslam
@JahidulIslam 2 жыл бұрын
You can use blivet GUI tool to manage few operations of btrfs. It is handy when creating or deleting btrfs subvolume.
@jonathandawson3091
@jonathandawson3091 2 жыл бұрын
Good video. I find it much much less confusing and error prone to use the subvolume name than subvolid in fstab, and that's what I would recommend. FWIW, timeshift also works seamlessly that way with no need to manually change fstab.
@andreicostache5325
@andreicostache5325 2 жыл бұрын
yes, thank you for the great video. If it were up to me, I would kindly request a more in-depth look at the mentioned feature of btrfs to extend storage by adding multiple physical drives (e.g. you have your /home folder on a separate drive, as you should, but then you want to add a second drive also for the /home folder... how would that look like in terms of btrfs?) thanks, and awesome video
@microcolonel
@microcolonel Жыл бұрын
Regarding btrfs RAID, the RAID1, RAID0, RAID1C3 (three copies), RAID1C4 (four copies), and RAID10 (mirror on stripe) configurations are all considered stable. The ones known to be unstable are the RAID5/6 strategies.
@Staniola
@Staniola 2 жыл бұрын
Great content as always! Huge thank you 🙏
@seths1997
@seths1997 2 жыл бұрын
btrfs has been included in fedora for the last 23 releases (introduced with fedora 13 in 2010) but if you are still saying it isn't feature complete, i'll stay with ext4 a bit longer
@williammckeever4790
@williammckeever4790 4 ай бұрын
I would like to know how this affects partition imaging software...
@tota_trader
@tota_trader Жыл бұрын
Very well presented. Thanks for your hard work.
@256shadesofgrey
@256shadesofgrey 2 жыл бұрын
If I have btrfs on / and have a /home subvolume, does creating a snapshot of / also include a snapshot of /home? Or would I in that case need to create 2 separate snapshots, one for / and one for /home to be able to completely roll back my system to a previous state?
@J.A.11
@J.A.11 2 жыл бұрын
Great video! I really like to see more videos about btrfs.
@nicoladellino8124
@nicoladellino8124 2 жыл бұрын
A very very nice video, TNX👏👏👏
@cristianinujazznight3044
@cristianinujazznight3044 Жыл бұрын
Hi. Getting trouble with snapper, could you help me? When I make a snapshot as default, then reboot, does not boot with the snapshot mark as default. How I can resolve this? Thanks.
@markjones2349
@markjones2349 2 жыл бұрын
I finally made it through this whole video after several attempts. I think I'm ready to make the switch and probably wont ever use any other advanced features for a desktop machine. I just was interested in using it on my Linux Mint desktop to have full drive compression with the simple fstab mount option for my NVME drive to squash down my steam library. Ark alone is 400GB on my drive and I did test btrfs out for a few minutes and it compressed down to 50% which is a huge saving of space. Like you said in the video I can use timeshift like I have already been but I will just tell it to use btrfs mode.
@edwardecl
@edwardecl 2 жыл бұрын
why are the defaults in fedora so crap... You don't need an ext boot partition, grub supports booting from BTRFS. You just need the EFI (fat32) partition if you have an EFI bios, also make a 1mb partition at the start of the drive for grub.
@KatyushaLauncher
@KatyushaLauncher 2 жыл бұрын
Fedora uses a separate boot partition for ease of recovery
@DCM777.
@DCM777. 2 жыл бұрын
Btrfs is controlling all my partitions Boot Root and Home and my snapshots are from the whole system not only Home! No need for Fat32 or Ext4! Works on Efi and Uefi.
@DCM777.
@DCM777. 2 жыл бұрын
@@KatyushaLauncher Nonsense.
@ierosgr
@ierosgr 2 жыл бұрын
At 10.25 you mention about instability of btrfs. Probably true (I ve read many articles about it being inconsistent - short of) but some companies like Terramaster (one came to my mind right now) are using btrfs by default for their Nas devices.
@bertnijhof5413
@bertnijhof5413 2 жыл бұрын
I have good experience with btrfs in simple configurations. I have used it in VMs with e.g Fedora and it works fine. I moved with my wife to her Dominican Republic and the Pentium 4 is still an used CPU here. So twice I installed Peppermint on a Pentium 4 HT with two IDE HDDs using btrfs in Raid-0. The system booted in 40-45 seconds, so I was very happy with btrfs. However as retired architect I have problems with the architecture of btrfs. E.g it is missing the volume and virtual disk objects, so it stores some of that data with the first physical disk of that "volume". In my opinion it is an architectural beginner's error and one of the reasons, that it will remain difficult to maintain btrfs for the more complex configurations. I also don't like the mixing of sub-volume; snapshot and mount point names. A snapshot is NOT the same as a sub-volume! Personally I use and prefer OpenZFS, a file system originally designed by Sun Microsystems in 2005. ZFS has a superior architecture and an elegant CLI. It has 2 additional objects essential for the more complex configurations; the vdev (virtual device) and the datapool (volume). It keeps dataset (sub-volume) name and mount point folder name separated and a snapshot is NOT equal to a dataset. Snapshot storage (the history) is read-only, so you can't change the history! The last 10 years before retirement I worked in Brussels on the boundary of architecture/standardization and politics, so I developed some intuition for politics. So I have the feeling, that commercial interests of some companies, that rule the Linux Foundation, block the inclusion of OpenZFS in Linux. The excuse is the potential license problems, but Canonical integrated ZFS since Ubuntu 16.04 without being sued and the same is true for many commercial server products like Proxmox; TrueNas etc. Personally I will use btrfs only as OS filesystem in simple hardware configurations like single disk; Raid-0 and Raid-1. Here I can profit from the built in compression, less storage but more important less IO operations. Also snapshots and the integration in Timeshift are reasons to use btrfs there. I will use OpenZFS always for my data storage, since it is more elegant and has a proven reliability. In the recent past I also used OpenZFS for OS storage, but I changed with 22.04, because I have the feeling that Canonical stopped all development on booting from ZFS. Currently since 22.04 I boot the Host OS (a minimal install of Ubuntu 22.04 LTS) from a 16GB ext4 partition instead of reserving a full disk for OpenZFS. I consider to move the OS to a 16GB btrfs partition to save space, iops and to to use timeshift :)
@johnp9890
@johnp9890 2 жыл бұрын
You will need ecc-memory for ZFS, or so i read on the internet, because allegedly there is no inherent repair mechanism, unlike in ext4. So a small error on writing can lead to data corruption . I always wonder how that works when you have a power outage... You might get an error too, which might not be correctable by ECC...
@bertnijhof5413
@bertnijhof5413 2 жыл бұрын
@@johnp9890 There is no filesystem in the world, that can protect you from memory errors, for that you always need ECC memory. That is the reason, that for servers they always recommend using ECC memory and because ZFS is mainly used by servers, they often recommend it for ZFS too. The repair mechanism in ext4 or ntfs is inferior to OpenZFS or btrfs. Ext4 (or ntfs) are only able to repair inconsistencies in the disk administration by using their journal. Ext4 or ntfs are incapable to correct internal file errors caused by bitrot or crashes during rewriting the file. If you end up with half the new file and half the old file, there is a fair chance that the application can't read that file anymore. Ext4 or ntfs cannot correct errors in the 10,000 different internal file formats in use, a system crash during rewriting e.g a mp3 file can cause problems during playing that corrupted file. OpenZFS and btrfs are transactional file systems based on Copy on Write, so the file will be either the new version or the old version before the crash. In all cases the internal file format will be correct and you can still play e.g that mp3 file. You did not understand an essential part of the video, so I advice you to watch it again, staring at 4:00 or google for the Copy on Write mechanism.
@johnp9890
@johnp9890 2 жыл бұрын
@@bertnijhof5413 ok. But if you do not have ECC memory installed i read that ZFS might lose a bigger problem if a crash does occur, because allegedly it has less repair mechanisms then ext4. Or so some sources on the internet say....
@williamp6800
@williamp6800 2 жыл бұрын
@@johnp9890 there is nothing in ZFS that makes it inherently dependent on ECC memory. But a computer with ECC memory will be able to protect your data better than one without it, no matter what file system is used. So yes, for absolute maximum data integrity, use ECC memory. But even without ECC memory, ZFS is the safest PC file system that I am aware of. BTRFS would be the only other contender. But I’m a file system enthusiast and not an expert so I could have missed something. I think the “must use ECC memory myth comes from two places within the FreeNAS (now TrueNAS ) forums. That “knowledge” then spread until it became gospel that you had to use ECC memory with ZFS. First, as a file system built for “big iron” and focused on data integrity, it was natural that the systems it first shipped on had ECC memory. When it became open source and moved into the PC space, it appealed to people willing to sacrifice some performance for the extra data integrity it offered. With that focus, the only “proper” way to deploy ZFS was with ECC memory because that gave the greatest possible data integrity. So that was the standard recommend for anyone inquiring about what hardware to use. So slowly “it’s even better with” morphed into “you have use” ECC memory because that is how to make the most of ZFS. Second, in the FreeNAS forums there was a very active contributor who was fairly knowledgeable about hardware selection and various aspects of setting up your ZFS storage for your intended use case. He wrote an essay about how ECC memory was essential because otherwise one memory error could cause cascading failure because it would caused a mismatch with the data and metadata on disk, with one failure leading to another, to another, to another, and so. According to his essay, without ECC memory, your ZFS storage pool was effectively a ticking time bomb, just waiting for the first bit flip in memory to bring the whole house of cards crashing down. The problem is it wasn’t an accurate assessment of how ZFS works and the consequences of a memory error. To the extend that a memory error will affect what is stored on disk, ZFS is either less vulnerable or no more vulnerable than any other file system. The other issue raised by some people against ZFS is that it doesn’t offer the tools to repair a corrupted file system that are present for other file systems. The response from ZFS experts, of which I am not one, is that the types of problems those tools repair don’t appear on a ZFS system because it is designed not to have them. The types of problems that can occur on a ZFS system are so severe that they would be just as unrecoverable as on any other file system. One other myth about ZFS is that you need to have at least one gigabyte of memory for each terabyte of storage. ZFS caches as much of your data as it can, so the more memory that you give it, the greater the likelihood that your data can be retrieved from RAM rather than disk. RAM is much faster than even the fastest SSDs, so yes, more memory is a good thing for ZFS. How much you’ll benefit from more RAM will depend greatly on the workload, type of data your storing, and the layout data sets, disks, and vdevs that make up your storage pool.
@bertnijhof5413
@bertnijhof5413 2 жыл бұрын
@@williamp6800 To support your last paragraphs with a practical example: On my backup server I use FreeBSD 13.1 with OpenZFS. It runs on a Pentium 4 HT (1C2T; 3.0GHz); 1.5GB of DDR (400MHz) and 4 HDDs in total 1.21TB (2x IDE 3.5" and 2x SATA-1 2.5"). Normally it uses around 1GB of memory receiving the backup, but I must be honest OpenZFS bypasses the memory cache (L1ARC) for the backup. However I can also use the system as desktop without problems using e.g Firefox 101 :) The advantage: my investment was $0 and the disadvantage: the backup takes 1 to 2 hours, because it runs at 200Mbps instead of 1 Gbps, due to a ~95% load on one of the CPU threads. That 19 year old CPU is getting somewhat slow for these modern times :) :(
@allanwolfe6071
@allanwolfe6071 2 жыл бұрын
Some history. . . BTRFS was developed by Oracle (not RH)" before they purchased Sun Microsystems who developed ZFS for Solaris UNIX. Oracle was developing BTRFS to be a performant filesystem on their fork of Linux that would support an Oracle DB environment. BTRFS was always behind in terms of features and stability compared to ZFS of which has long been stable for 10-12 years. ZFS was introduced in Solaris 10. I figured after the Sun purchase, they'd adopt ZFS and ditch BTRFS. It looks like Oracle has given the BTRFS project over to be open-sourced under an Apache 2.0 license. When Oracle controlled the project, back when, it was under a pseudo proprietary license (best my memory serves me). While an astute administrator has a workable and tested backup and recovery plan, having a stable and performant filesystem is equally important. I would prefer to rely on ZFS as a part of that plan than to plan for when BTRFS will fail or slowly rot data (which usually goes unnoticed), especially in a virtualized environment. ZFS provides the ability to take snapshots and able to move pools from one host to another, though a bit clunky when compared to truly clustered filesystems for Linux (e.g. Ceph, Gluster).
@maksimmuruev423
@maksimmuruev423 8 ай бұрын
What will happen if you remove origin subvolume and keep only snaphot? Will it cause any problems? For example I did failed update, and rollback and started use old snaphot, and it time faulty origin have no use to me.. can just remove it? And put snaphot as 'origin' for others?
@jonathanrider4417
@jonathanrider4417 2 жыл бұрын
I use both Linux Mint and Ubuntu - the improvements to Timeshift enable reliable backups - only criticism is inability to store in a remote location - I can move the archive after as a workaround. So I will continue with ext4 for now but thanks for this.
@VJ-zm5xi
@VJ-zm5xi 7 ай бұрын
Thank you for the video!
@ricardokullock2535
@ricardokullock2535 2 жыл бұрын
With partitions, I could re-install my system without touching my home folder. Is that possible with btfs?
@patriark
@patriark 2 жыл бұрын
It would be awesome with a new btrfs where you advice on some efficient backup systems, how to interact with external drives, NAS and possibly even syncing across clients. Maybe one practice for server backup and one for desktop/laptop.
@Flackon
@Flackon Жыл бұрын
I'm getting quite bad performance using btrfs during copies of large amounts of data on my Arch installation. Hopefully I can find some answers on this video and see if it's fixable, since it's pretty bad for e.g. playing games
@ironmanlifts
@ironmanlifts 2 жыл бұрын
Hey Jay, thanks for the video been waiting for this one since your chat about it on Lawrence Systems. I successfully installed arch today with btrfs, systemd boot, and luks. :D I was having problem with the kernel but once I downgraded to LTS everything was fine. I'm not too sure about the additonal flags in arch.conf for systemd-boot but it's working.
@mikel8190
@mikel8190 2 жыл бұрын
I've been using btrfs on Debian since bullseye was released and it's great. I have separate root, home, and snapshot subvolumes and can boot home and root snapshots with dmenu scripts.
@petruspotgieter4561
@petruspotgieter4561 2 жыл бұрын
Are they still working on implementing the snapshot restore command? Seems a bit incomplete having to edit fstab file.
@komptek
@komptek 2 жыл бұрын
Fantastic video. Please make a video on how to convert from existing ext4 install to a BTRFS instance. This would save so much time from reinstalling and configuring some linux systems. If that is possible!
@PeterKese
@PeterKese 2 жыл бұрын
Check "man btrfs-convert" for documentation. It can convert an existing ext4 filesystem in-place into btrfs (without losing any data). If you decide that you didn't like btrfs, you can even roll-back to original ext4 (and get back the same contents of ext4, as it was before initial conversion) ... however rollback only works until you have run btrfs-balance for the first time. You should preferably make a backup and boot from USB stick, when doing the conversion.
@MM3RTH
@MM3RTH 2 жыл бұрын
My Synology NAS uses butter-fs. Keep telling us more Jay. Many thanks laird Bill.
@فیزیکاستراتژیک
@فیزیکاستراتژیک Жыл бұрын
Thank you. Please create more content about btrfs.
@LearnLinuxTV
@LearnLinuxTV Жыл бұрын
I hope to do exactly that :)
@TheExard3k
@TheExard3k 2 жыл бұрын
I completely switched to BTRFS and ZFS on all of my PCs and servers. I'll never go back to NTFS/ext/xfs/whatever
Starting With Linux: What I Wish I Learned First
23:31
Learn Linux TV
Рет қаралды 494 М.
Linux Crash Course - The /etc/fstab file
30:29
Learn Linux TV
Рет қаралды 111 М.
Маусымашар-2023 / Гала-концерт / АТУ қоштасу
1:27:35
Jaidarman OFFICIAL / JCI
Рет қаралды 390 М.
"Идеальное" преступление
0:39
Кик Брейнс
Рет қаралды 1,4 МЛН
Вопрос Ребром - Джиган
43:52
Gazgolder
Рет қаралды 3,8 МЛН
Proxmox VE - How to build an Ubuntu 22.04 Template (Updated Method)
24:25
Hardware Raid is Dead and is a Bad Idea in 2022
22:19
Level1Techs
Рет қаралды 695 М.
What is BTRFS?
30:00
The Linux Cast
Рет қаралды 31 М.
Linux Crash Course - Understanding Logging
29:10
Learn Linux TV
Рет қаралды 54 М.
Linux Crash Course - The df and du Commands
20:28
Learn Linux TV
Рет қаралды 31 М.
Which Linux filesystem is best in 2022?
19:32
DJ Ware
Рет қаралды 78 М.
18 Commands That Will Change The Way You Use Linux Forever
29:50
Akamai Developer
Рет қаралды 1,3 МЛН
Linux Crash Course - Formatting & Mounting Storage Volumes
32:28
Learn Linux TV
Рет қаралды 268 М.
What Is ZFS?: A Brief Primer
31:50
Level1Linux
Рет қаралды 209 М.
Маусымашар-2023 / Гала-концерт / АТУ қоштасу
1:27:35
Jaidarman OFFICIAL / JCI
Рет қаралды 390 М.