StoreMI: Why Tiered Storage is better than cache on x470/Zen+ and Threadripper

[@blankname8975]

"Some operating systems waste your time" "Kinda like I do sometimes when I ramble on and on kinda like I am doing now" Wendell, you're the Bob Ross of Rambling about "Computing" in broad terms. I fucking love it when you ramble. Keep rambling!

[@rasong]

I would listen to hours of your rambling. There is so much interesting little bits of information you give when you ramble that makes it so worth it.

[@merevial]

You really scratch my data hoarding itch.

[@xaiber16]

NSA..

[@Bunjamin27]

I'd love more L1 Linux content - what it looks like, difference, why they think people should use it etc. I'm subscribed to the L1Linux channel as well, hoping for more content for dummies :)

[@RsGOD-if9rs]

when this man opens his mouth, there is no other option but to listen intently

[@ErgonomicChair]

That is... Very true. I was trying to write with this in the background and, nope.

[@randalllawkin]

Amen

[@adoredtv]

Great cheers, saves me researching it. :D

[@wiz126]

Same as Intel's Smart Response Technology they have had since like 2010...

[@brunosalezze]

StoreMI also uses 2GB of ram in the Tiered Storage

[@wiz126]

You can actually use a whole RAMDIsk with RST/SRT.

[@darkoparko6685]

hope it goes into your next video :D

[@AdamWykes]

CAN use. doesn't by default.

[@danawinters9996]

this video made my inside feel warm, happy like sunny spring day. It has also engaged my sense of technology wonder.

I don't mind you to rambling on. This is actually fun to hear you speak and gives you character. 😁👍

[@kylepatton7289]

First video of yours I've watched. Excellent information with a concise delivery. Thanks so much!

[@Hostilenemy]

StoreMI Daniels is a hot topic right now.

[@Dennell_Mount_and_Blade]

Underrated comment.

[@S0oo]

*Threadripper & Optane* or *Romeo & Juilet* forbidden love

[@Dirtyboxer1]

Remember how Intel made such a big deal about Optane only being used on Intel platforms? I think someone at AMD saw that and said, "I got this. Hold my beer."

[@chriswright8074]

michael gregory lol pretty much he was lets fix this in a few months

[@julianruggiero9701]

Once again I'm super happy I bought into threadripper! Gonna try this out with an old 256 GB M.2 and a 4 TB HDD. With any luck, I won't need to separate out stuff based on how quickly I want it to load. Thanks Wendell!!

[@randalllawkin]

Man I really love this video I had to watch it again because I had a question about using optane with StoreMi but you answered it.

[@AnarKloot]

Good stuff Wendell! And yes, please do cover open-source alternatives on the linux channel. Apart from monitoring file usage I've got tiered storage working on an x370 system (Unraid; nightly mover). Being able to do smart and effortless file relocation is the holy grail!

[@MantaProx2]

Thanks for reviewing this. I would not have picked up on this feature. This cemented my Ryzen build for me.

[@PeteTheL337]

Thank you for educating me. Will certainly be looking at this a bit closer. My ssd is starting to feel the pressure of all the games i want on it and this will certainly help fix that.

[@f4z0]

This is gold information. huge thumbs up from me.

[@mtstans]

I didn't realize x399 supported this already. Perfect timing for my 3 HDDs that just came in to stuff along with my 2 x nvme drives. woots! Good Info! Thanks!

[@RaidenKaiser]

I just tried it out...this StoreMI thing is amazing!

[@jojoskunk]

No wasting of time or rambling of noting good to have your opinion. Awesome video, always learn something... Good technical info and exemple! . Just enough to interest me or not... and if i will make more research in the subject.

[@SgtStinger]

So THAT'S what Optane is for!

[@saikrishankumar]

You are awesome Wendell. Great video. Thank you.

[@GreatGodSajuuk]

You missed one very cool fact, Enmotus (the folks who make the software) are offering a deal for ALL Zen systems on all Zen mobos, 20bucks for what you demo here and 60 for a 1tb fast tier sollution. It's a REALLY good price for something so useful. I'm gonna grab the 60 buck version for my R7 system.

[@Odin3v]

The updates that have been to StoreMi since this video have been awesome. Using it with a 256gb m.2 sata and 3TB for my threadripper that I use to stream games with moonlight to my phone is great. I do have 2x1tb Samsung 860 evos I use as game drives as well but the 3TB holds more games, this tech still works wonders. Planning on upgrading the 256gb m.2 sata to a 2tb NVME and 8TB black drive soon. This video is so well done, and so much proper information. Major props.

And it's so outdated.

[@audiogarden21]

I enjoy the fact that you are comfortable calling out "utter crap".

[@dizzymetrics]

lol the gigglings It really is hilarious how Optane works better on an AMD system.

[@StevenKger]

I like your content. Very in-depth and HQ. Cheers!

[@HuMaNiTaRiAn1]

When are we getting more techie stuff on the linux channel, heard it being mentioned a few times regarding follow ups?

[@BillyOfTea]

I got suckered into buying a Hybrid Drive, Never Again. Thanks for the explanation.

[@glenwaldrop8166]

Primocache does something similar, works like a champ and is very configurable. I prefer it, in part, due to the fact that if your cache drive dies you lose nothing. I'd like to see a side by side comparison between the two. Caching vs tiered, seems both have the same end result but caching doesn't risk losing data, tiered does.

[@RazorSkinned86]

Finally! Can't wait to watch! Next the ECC video?!

[@leoworrall9449]

Engaging the algorithm

[@ByteRoster]

E N G A G E M E N T P O S T N G A G E M E N T P O S T

[@dizzymetrics]

ENGAGEMENT NGAGEMENT GAGEMENT AGEMENT GEMENT EMENT MENT ENT NT T

[@eli72481]

engage

[@TheSlyMouse]

Gauging engagement

[@ISKLEMMI]

I, too, am engaged!

[@JefeRoca1969]

Ty for the intel in this tech, great video.

[@gabrielgrosu2976]

Well.. this is awesome. 10 for the presentation.

[@interlace84]

HP used Intel's Rapid Storage Tech (*RST) in a couple EliteBook series to use a 32GB M.2 SSD as cache for a 500GB HDD -- half of those systems got corrupted in our userbase. Last I heard they took it another step and started calling it Optane..

[@TheGuruStud]

interlace RST driver memory leaks massively, too, on some systems. Piece of crap.

[@ovedurak]

interlace so what is the difference between tiered storage and intel rst?

[@vgamesx1]

o.vedurak rst is mostly just standard caching you get from any other software solution except it used the raid chip but it also had a bunch of restrictions put on it, such as Intel only systems, minimum SSD of 18.6GB and a max of 64GB, maybe a couple other things I'm forgetting but yeah, pretty all around crap, then they did basically the same thing with Optane... If you really want a software cache then find a third-party solution such as primocache but even that isn't great, from my experience it's never crashed or corrupted data but once the cache filled up on a cheap 16GB ssd I had, it would actually make my computer slower as it would dump something and try to read new data into the cache.

[@interlace84]

o.vedurak in Intel's case their chipset-integrated raid controller handled the caching instead of a driver (OS-independent) and you could choose between write-back and write-thru caching to go for performance or stability. It needed Intel's windows gui-based tool to set it up, tho... Unfortunately, firmware bugs. Lots of em.

[@poseidon3032]

Not a very robust file management system. I got two SSD's: one for Windows, one for games; two HDD's for downloads, archives, and backups and called it a day. Everything's segmented, easy to back up, with no file management jedi tricks. Even Windows can keep up with it.

[@RANDOMNATION907]

Why am I just now finding this channel? Thank you for the run down. subed.

[@evergreenalba]

Very informative 👌 I was considering purchasing a larger SSD, but now I'm going to get an 960 Evo and a large capacity Seagate Barracuda. It sounds like I'll likely see increased speeds and greater capacity storage for less.

[@rolandddd]

I want that linux video. I actually could use that stuff :) can't wait

[@dreadlock17]

This is why i love level1tech

[@jjgroenendijk1218]

I would be interested to learn more about a Linux equivalent (:

[@BennyFade]

Wow, thats amazing! Can‘t wait to try it out on my new system!

[@plhilmar1]

Let me quote one of Wendell's phrases, "THIS IS AMAZING!!" We need more enterprise stuff trickling down to rest of us in the consumer space, power users and peeps in the know eat this stuff up.

[@jawadkazmi5327]

Awesome review. thanks for explaining StoreMI. cheers

[@TheSilviu8x]

good point, this is the way is supose to work, the pc is the one to figure out how i need my stuf to run! kudos for amd

[@stephenreaves3205]

This reminds me of ZFS. Especially when you talked about your "Storage Pool"

[@Neumah]

Good stuff this. Thanks Wendell.

[@EURIPODES]

I'm no computer wizard but I used a ssd plugged into a usb 2.0 as a cache and it really did improve system responsiveness. I just bought a new x470/2600 system. I'm waiting on my graphics card to arrive before assembly. I'll be very interested in watching some tutorials on how to set up optane and what card would be best for my gaming/general purpose needs.

[@johanvanrooyen8441]

Looking forward to playing with it when my Ryzen arrives!!

[@Dirtyboxer1]

Looks like the StoreMI feature is a lot more interesting than it appeared at first blush.

[@ALTRON3]

This is the most informative storemi vid out there. thanks :)

[@Nomaran]

That’s actually pretty neat. I’ll have to try this out on a system I have. I think I have a msata drive somewhere

[@eber.antony]

Great video Wendel!

[@johnpaulbacon8320]

Nice video. I bet a Nvme ssd as your fast storage and a sata ssd as your slow storage would be a Rockin Setup.

[@TheLordinio]

A video about storage tiers in Windows 10 storage spaces would be cool. I had some trouble finding out how it handles data and people report wildly different performance

[@7cyber]

Hello ! Windows not dogma and Windows 10 too, many live system not need to install and work very good in RAM ! Good video, no good 'crap' offset !

[@mrtukpitsu650]

Great as always- I love it that AMD made Intel Optane hardware actually work !!

[@HypnoticSuggestion]

This is very interesting, adds another reason to check the AMD box for my next build. Milking X99 right now, for all its worth.

[@leviathanpriim3951]

great vid L1T team

[@carlwells9504]

FINALLY- Someone has done a video on Storage MI. This plus the longevity of the Ryzen platform is why it will be my next upgrade. Question though- How does this all relate to raid???? I'm guessing it pretty much takes away the speed benefits but how do I do a backup?

[@johnbovay8353]

bios_grub + swap + / partitions on an SSD, with /home on a 6TB HDD; both using the GPT partition map and both plugged into two ports of either the SB950 or the internal ASM1062 on a Sabertooth 990FX R2.0 = approx. 80%+ of the SSD's overall feel with the convenience of a big, affordable home folder. When partitioning the HDD I create separate bios_grub, swap, / and /home partitions, format each of them to ext4 and assign the 'hidden' flag to all but /home. That way I have the option of later installing an OS onto the HDD if need be without having to resize /home or re-format and partition the drive.

[@bobalazsgaming]

I contacted Enmotus Support the maker of this Fuze (AMD StoreMI) software about this bug where the system drive SSD that is run by the same AMD VIrtualized AHCI Controller for StoreMI as the StoreMI configuration, even though it is not part of it. Meaning it's a system ssd that is not part of StoreMI. Because of this AMD driver, trim can not be run by the OS, the Operating system can not send the trim command to the drive. They got back to me and said that this is a long standing bug, TRIM is ineffective for any non-FuzeDrives attached to their controller driver. Trim is less important nowadays, and other bugs and features got pushed higher on their priority list.

[@ileandrolopes]

Great video! Very informative and simple to understand this tech, sadly my r5 1600 + b350 didn't came with this software license, so I may need to buy it. But i think it's worth it.

[@hk07666]

A wild engagement has appeared!

[@sgtnik4871]

This is so great!

[@Lemonade1947]

ty 4 gr8 video. just commenting to feed the algorithm

[@lsatenstein]

Great introduction

[@JamesAColemanFan]

Got to feed the algorithm. Good video guys

[@JosephGamacheKD0AHS]

Feeding algorithm? 100000 unique interactions. Feeding Boiler Snake? Priceless.

[@goldbrick2751]

Love your rumble man.

[@kent6732]

The servers themselves do not "know about" the tiered storage. It's handled within the array via policies. Very common to have 3 or more tiers. Flash/FC/SATA for example. How much of each is up to how much you want to spend. EMC's solution is called FAST. It usually helps more with reads than writes since writes go to a huge cache anyway. But you need very very stable power redundancy in order to have a cache (ie. RAM) handle writes until they can be de-staged to disk. Very cool to see it come to PC if it's implemented properly.

[@gregrich91]

I may be your bottom tier patron, but you're my top tier YT channel.

[@papal1ef]

Thanx wendel :)

[@ldmnyblzs]

Looking forward to the video on the Linux solutions. Bcache has worked for me so far but I'm open to something new.

[@pretendawatch]

Love the turtle neck!

[@wpmann01]

Looking forward to your video about similar solutions for Linux!

[@jeffm2787]

StoreMI works great, it's a pain to remove the tier when you want to change things and can be frustrating in that regard. If you know what you're getting into going in it's great. I run a 6 TB WD Red with an 850 Pro 512GB and FuzeDrive. FuzeDrive is the exact same product just with less limits if you pay for it.

[@TheArchetypeGamer]

Cool software not sure what else say this morning but, engagement

[@0M9H4X_Neckbeard]

GREAT VIDEO

[@FlumenSanctiViti]

Nice review of the tech, but no mention of how it works with RAID or can it work at all?

[@FireMrshlBill]

I'd love for this to be available to any 2 drives on the system and not limited to the boot drive + expanded storage drive. I have my boot+applications on a nvme, my games on a ssd, and a hdd for data and run-over applications I dont want on the nvme. Depending on future projects, I'd love to put another m.2 or ssd in there and have it do the storeMi with the hdd (and leave my boot nvme and game ssd alone).

[@zombiesolutions95]

seems a good option if your rotating out an old drive to a new drive also on a scheduled basis.

[@Seth_Samson]

I would like to see your revised the new StoreMI now ..

[@thebaitthatisnatori157]

#Feedthealgorithm

[@soowepic]

Do you mind revisiting that topic since AMD has expanded their StoreMI feature set?

And since Enmotus has closed shop…

[@anicybergroup3678]

thIS IS a VERY gOoD CHannEL.

[@cesrai]

Thanks

[@shano2aks1]

Such engage. Many algorithm. Wow!

[@mannyc19]

Great video,thank you. Why can't it support more then 2Gb of ram cache? I have lots more ram to play with.

[@qingdom]

Mr. Wendell, AMD had revised StoreMI this passed. Can we get an updated review on StoreMI 2.0, its changes, and performance than compared to 1.x please? Thank you.

[@kcmackie77]

You are awesome.

[@paulbailey1276]

This is awesome! Thank you for the video. I am glad my new computer is AMD. I have a reasonably good M.2 drive and a lot of spinning rust. AMD FTW!

[@SaccoBelmonte]

Subbed and bell on "all"

[@walktxrn]

The real benefit to this for most people I would think is adding on a HDD after a SSD exists... and it just 'auto-magically' working.

[@aminamchannel]

dell wasnt the only one using sshd. anyway we bought a whole load of lat 3540's back in the day all using sshd. When first checking them out they were quite fast and we just thought "well these cheap things are great for the job". 3months later the 5400rpm disk got the better of us and turned our opinion in something like "stupid slow shitboxes, cheap always turns out expensive we should have known that".

[@tomsmansvards]

Sounds similar to creating symbolic links on Linux, BSD etc. between your drives. The drawback is that it should be done manually and may involve copying large amounts of data, but the bonus is that it's easy and it's always clear in which drive the actual data is located and you are not tied to a specific hardware or program. I find it scary to have a local "cloud" on your computer if something breaks down and you lose, for example, your MB with the AMD chipset (although I hope StoreMI allows to easily recover the data in such cases).

[@larrygall5831]

OK, I have questions. I use a RAM Caching software called PrimoCache. I use a 120 GB SSD, split it in half, and these 60 GB halves each cache one mech drive.. this is L2 storage. On top of this, I have 32 GB RAM, and use half for caching (which itself is split in half, with 8 GB going to each mech, which is already cached by the SSD). This is L1 storage. My system is lightning fast, and Crystal Disk Mark shows around 7000 MB/s for a drive that barely made 200 MB/s without caching. I use it mostly for games, and the 60 GB chunk of SSD will fit whatever I'm currently playing, and 8 GB of the most used game files will be in memory. I have monitoring (Aida64 sensor panel) showing drive use, and after playing a game for a few minutes, it stops reading from the mech altogether. After the first time playing, every time you start that game thereafter, it no longer looks in the mech drive.. it just loads the RAM cache from the SSD, using what won't fit directly from the SSD. I'm wondering how this is different from StoreMI, other than only being good for a small space (without paying)? I know this is a bit confusing, and I know some are always tempted to say "just buy a big SSD", but I have 18 TB of mech drives (3 drives), and a big SSD is quite expensive. I have a Samsung SM-961 256 GB NVMe for a boot drive and has nothing to do with the cache system (it doesn't need it). And honestly, the Samsung is one of the fastest drives around, but it's half the speed of this cache system (from memory). I think this StoreMI sounds limited with the free version, and I'm wondering if A> it's any faster than what I'm doing now, and B> how much it costs to "upgrade" to larger capacity.

[@RobertD_83]

Great info

[@charleskuhn382]

I'm gonna buy all the datas!

[@SinX897]

Great content! Subscribed