Audio Reactive Animations with Stable Diffusion and TouchDesigner - Tutorial 3

[@Interface3072]

Incredible work and fantastic tutorial - thanks so much for sharing!

[@sampak6839]

This is so exciting, can't wait to try it tomorrow. I am sure it will be super fun, thanks!

[@jonas8732]

i literally can not express how much i needed this tutoria.. thank you soo much!!!!!

[@rufiyan]

you're the greatest man for this

[@nicolaseastland1447]

Super cool technique. For sure looking forward to trying it out.

[@RisteardOhA]

Incredible, thanks for sharing!

[@alexeyparkhomenko6237]

great tutorial, thanxx!

[@vongolance]

Hey Torin, amazing tutorial! Can this be run on local stable diffusion? So there is no need to go through computerender?

[@hobohippy1616]

boom cheers for the inspiration

[@matthewortega4858]

Added my own API key but doesn't seem to be working. Am I missing anything?

[@BenHeim]

Amazing stuff mate! Thanks for building such awesome comps

[@bartholome3652]

Very nice tutorial. Much appreciated! Do you know why sometimes it takes very long for the computerender to push out images?

[@blankensmithing]

thanks! I'm assuming this video brought a lot more active usage happening at the same time. In general I've found it to be very responsive :)

[@bartholome3652]

@@blankensmithing Thanks for your reply. Works better now!

[@Cazametroides]

Hey man! Great video! Would be amazing if you could give some info into how to adapt this setup for running Stable Diffusion locally

[@blankensmithing]

Check out @dotsimulate's setup. He has a local setup you can use. I wanted to make sure this was accessible to the most number of people so I went with an API

[@ArgoBeats]

Beautiful, thank you Torin! Is this kind of Audio Reactive Animation possible even in real time, say for a live event while playing a midi device?

[@blankensmithing]

Thanks! At the moment the plugin uses an API, so you don't need to have a fancy GPU to run it and it'll run on Mac + PC. It'll generate the images at around ~3fs. The API is running the model mainly on RTX 3090s, so it's not quite there for real-time yet unless you kept the resolution really low, or the iterations low. I'm not sure how fast the model runs on a 4090 though. I'm sure in the near future there'll be some optimizations that'll bring things closer to real-time.

[@ArgoBeats]

@@blankensmithing great to hear, thank you again Torin.

[@brandon_stargrave]

I've been trying to work at 720x1280, which actually seems to come back as 704 x 1280, no big deal. But once in a while, when I start recording with the MovieFileOut, the resolution randomly changes to 320x640. Haven't been able to track down what's causing it, but there's definitely some strangeness with the resolution.

[@blankensmithing]

The size auto rounds to the nearest power of 2. When you're using img to img it only looks at the resolution of your video

[@aaronc.1362]

@@blankensmithing So how to fix this, i faced the same problem and the resolution is unuseable.

[@blankensmithing]

@@aaronc.1362 The max resolution with img 2 img on is apparently 768 X 768. You can use a Fit TOP to resize your input. When img 2 img is turned on it uses the resolution of the input instead of the resolution you specified on the computerender component

[@michaelhyp765]

Hello Torin! This is fantastic, thank you for the clear tutorial! - when I use the transform/scaling feature my image starts to degrade. Is there a viable workaround to keep the images at a consistent res through the animation?

[@blankensmithing]

Hey make sure the seed is changing every time

[@raamsanghani9187]

Thanks for the tutorial man! I did have a question - for me, I'm noticing that the transform zooming in effect doesn't quite seem to be working for me, nor does the rotation 🤔Anything that might be good to check out? Update: nvm - I had the cross all the way up to 1 which is why nothing seemed to be happening 😅

[@MrBloodmonster]

Thanks for your tutorial! how far do you think we can do this real time, with low request cost and not neccesarily expensive harrware need it thank you

[@bartholome3652]

When I try to use a seed from an image from Lexica, I often get an error. Happens when the seed is very high. I guess the seed can't exceed a certain number. Any workaround?

[@dougeasterly]

whose paintings are those?

[@youngp7510]

when i generate images , every iterations is super different , either i put the strenght super low and i only get one frame , like at 0.01 or if it is around 0.1 it just changes image every time , i cant seem to make slight changes to images any ideas on solutions?

[@outsandatv]

Great tutorial format and explaination ! I think the vidéo deserves to be a bit shorter in lenght but overall it's great !

[@marcomelilli166]

thank you very much for sharing this project, I tried to generate images and everything worked correctly until yesterday. Despite I added credits on computerender, since today, when I generate an image I get an error back “ {”status“: ‘error’, ‘message’: ‘Could not find \’complete\” state within timeout. You may try again.", ‘errorType’: ‘INTERNAL_ERROR’, ‘jobId’: ‘60f87997ecc64cba35e185a74ed0a4498c1b89e5’} ‘ ’, could you tell me how to fix it? thank you very much, i love your channel!

[@bardoof]

I've the very same problem. It worked correctly until few hours ago...

[@ryhorvaladzko]

Error: (Parameter: Experimental) AttributeError: 'td. App' object has no attribute 'experimental' (/project1/computerender/docsHelper)

[@ThePinnxx]

Hello, Im running a 2021 version of Touchdesigner that is paid for, cant afford the update as yet.. having lots of errors running the program on this version, is there a workaround I wonder?

[@blankensmithing]

i’ve only tested this on newer versions of TD

[@JannatShafiq-fr4lr]

@@blankensmithing Hey can u plzz give the link for that version?