Houdini Tutorial: Reduce Cache Size by 90% - Data Optimization Techniques

Welcome to this comprehensive Houdini tutorial on data optimization techniques! In this video, we'll delve into the fascinating world of reducing cache size using powerful optimization tricks. Whether you're a Houdini beginner or an experienced user, this tutorial will equip you with essential skills to optimize your data and enhance your workflow.
🖥️ Software used: Houdini 19.5.303
🔔 Don't miss out on the latest tutorials! Subscribe to our channel for more exciting Houdini content and stay up-to-date with the latest techniques in the field.
👍 Like, share, and leave a comment if you found this tutorial helpful. We value your feedback and would love to hear about your experiences with data optimization in Houdini.
.
.
.
Support Me On:
/ vfxmagics
vfxmagic.gumroad.com/l/support
Suggestion (Request Topic): forms.gle/iKCMhvj3KY9w6gy26
Get in Touch: [e-mail]
Facebook: / vfxmagics​
Instagram: / vfxmagics​
KZbin: / vfxmagics​
Gumroad: gumroad.com/vfxmagic​
Telegram: t.me/vfxmagic​
SideFx Houdini: www.sidefx.com/​
#houdini​ #tips​ #vfx​ #magic

[@VFXMagics]

More Info: Another technique to consider is using the "extractTransform" node to capture the position and orientation data of a moving geometry ( not deforming ). By caching only these key points, you can significantly reduce the amount of data storage required. Once the points are cached, you can utilize transform pieces node post-cache. I've also done some research on using a single Alembic file, and I tested it on the crag scene ( unpacked ). It consumed unpacked 1.21 GB Size ( packed 504 MB ), and it will save in USD format with the same size.

[@emilsvfx]

yes wanted to write about extracttransform for the packed objects it can store PSR , but yes it only works only with non deforming mesh, constand point count.

[@RealRiceCakeCookie]

Thanks for sharing!

[@fxguruofficial]

Very important stuff, Thanks for sharing.

[@jaitdp12]

Very informative thanks for sharing👍

[@kir11]

Very cool! Thank you!

[@paoloricaldone6273]

Thanks!!!

[@kalpeshsolanki3334]

Its Very Usefully Info Thanks....

[@ablae1234]

❤❤ Thank you

[@pranaymundada]

Very useful 👍🏼

[@Ch405G4m1nG]

Yes yes yes yes yes

[@marioleone502]

Thank you for sharing, can we assume that this will speed up render times bc caches are smaller?

[@VFXMagics]

Technically, using Wrangle or VOP, it still takes time to read data. While it can save some disk space, it won't necessarily speed up the render.

[@anubhavupadhyay1966]

sir in my version is not show that node is not like that how can i get this node

[@EliRezik]

does this work for RBD simulations? like a braking glass?

[@VFXMagics]

It works best for RBD, actually. In fact, in RBD, you get a chance to save points only. So, I recommend saving a single frame on glass geo and the full range of sim points so you can save 95% of data.

[@lewistaylorFX]

The problem with this method is it is only helping you save space for data that is going to come back into SOPs. You cannot use this to render, as you'd need a procedural at render-time to do the transfer. Single alembic Vs per frame alembic is already doing a very similar method to what you've shown, USD data format is also furthering this, and both those data types can be directly rendered, either in houdini or another DCC. Have you found it usable for final frame rendering, or more an intermediate caching reduction workflow?

[@VFXMagics]

Hey Lewis, Of course we can use this for the Final render check this kzbin.info/www/bejne/jGipen6JmNx2lac I've also done some research on using a single Alembic file, and I tested it on the crag scene. It consumed 1.21 GB Size, and it will save in USD format with the same size. So, I'm importing an optimized version of the scene, which is only 199 MB, directly into Solaris. It's working well, but we still need to recompute the velocity. Other than that, everything is looking good! To export the optimized cache for use in other software, we can try using a Houdini Digital Asset. Although I haven't personally tested this approach, it should allow us to load the optimized cache into other software. If for some reason this doesn't work as expected, we can resort to caching it using the traditional methods we've used in the past.

[@lewistaylorFX]

@@VFXMagics anything you load into Solaris that is coming live from sops is going to be buried in the exported usd stage, it won’t be a reference or delayed load. USD export has the same functionality to store and transfer data, we use it for hair. The problem with making a hda is you’d need to inject hengine into the mix, that will pull memory and a license. I don’t know how it would scale either, with big data sets.

[@VFXMagics]

@@lewistaylorFX I haven't specifically cached anything additionally for rendering in USD. However, if it's necessary, we can explore the option of using temporary caching as you mentioned for the USD export.

[@lewistaylorFX]

@@VFXMagics yeah that’s what I mean. If you export the usd stage that data will be baked in as a binary instead of referencing. Then you will need to call hengine and run your sop data transfer, that’s where these methods of cache reduction fall over as they need a process run on them to be usable.

[@IanFrederick01]

great tutorial! How can I apply this technique to a FLIP, POP, or RBD sim like you are showing in your teaser trailer?

[@VFXMagics]

Hey in trailer demo i have used constant particles only, u can use wrangle or vop inside dop or post dop and read P after cache

[@benlemoine75]

Did you compare with alembic ? I believe alembic is able to do it in the same way

[@VFXMagics]

Yes, tested on crag geo .abc and .usd both consumed 1.21 GB size

[@mercedesflatley]

*promo sm* 😊

[@nyashkov]

i follow this guide, but it dont works and i made another way. in wrangle i wrote v@storeP=v@P; then attribute rename i changed name store`@Frame`

[@VFXMagics]

Which Houdini version are you using?

[@nyashkov]

@@VFXMagics Hi, 18.5

[@nyashkov]

@@VFXMagics I was able to add the frame number to the attribute name, but then I can't reproduce it using your code in Wrangle

[@VFXMagics]

@@nyashkov Yes, this code doesn't support Houdini versions older than 19.5. In this tutorial, I am using version 19.5, which is why it is working.

[@nyashkov]

@@VFXMagics thank you very much!