Stable Diffusion - Starting with a texture, what can we discover? Exploring textures for AI Art.

I was brainstorming today and thought it would be fun to see what might come crawling out of a texture if I gave it a hint! It is somewhat the same mindset as diffusion itself, as the painted textures are a sort of noise, but this was just a fun diversion and I thought I would share it with everyone. What do you think?
Check out Dream Studio here: beta.dreamstudio.ai/
Here are some excellent references on CFG_Scale and Steps and the Sampler settings that might work best for the type of imagery you wish to create.
Stable Diffusion Sampler Studies:
docs.google.com/spreadsheets/...
Stable Diffusion CFG Studies:
docs.google.com/spreadsheets/...
Join my Discord server, where we create ideas together!
/ discord
New! Become a member to get exclusive access to perks!
/ @sedetweiler
Enjoy this video? Consider buying me a coffee! ko-fi.com/sedetweiler
Twitter: / sedetweiler
Instagram: / sedetweiler

[@filip0112]

Hard edges and well defined shapes are real no go for ai creativity, however little bit of blurring adding noise etc. can provide more loose aproach for inpiration aspect of image generation.

[@sedetweiler]

Yup. This was a fun experiment for sure.

[@kimblagg8090]

Absolutely enchanting!!!! You are truly a master at this.

[@sedetweiler]

aww! thank you! give those textures a try! I had a ton of fun (and am still messing with them).

[@Hyper5nic]

That is indeed a really interesting way of using textures. I wonder if grungy, metal (rust?) or stone textures, will work well with steampunk or either statuesque inspired prompts.

[@sedetweiler]

You should try it!

[@mr.e2643]

A good way to generate "textures" with stable diffusion is to combine two paradoxicals and use swap|swap, and low steps, you could use that as your texture start point Ed: for example night|day, should work, maybe weight them too. It should make a bit of a mess that looks like a texture

[@magenta6]

Great Idea - a bit like taking a block of wood and starting to cut into it and letting the grain influence the result.

[@sedetweiler]

That was exactly what I was thinking, but more in the case of stone or clay, since I am useless at woodworking. 🙂 The idea is the same, in that those textures are unique and can add or inhibit the images they provoke.

[@siffertlouis535]

Thank you for sharing, as other comments said : maybe you could make a another video using other types of textures and prompts (something like metal with cyber cop for instance) of course i will try those out on my own too !

[@sedetweiler]

Great idea!

[@uwepleban3784]

I used Disco Diffusion over the summer for texture experiments. Worked very well, but the execution was, of course, much slower than with Stable Diffusion now.

[@sedetweiler]

Still a great tool for exploring these!

[@FilmFactry]

Hey Scott, wanted to share this with you, try it out, getting some crazy images -- Human shadow, magical power, 3d, 4k trending on artstation, intricate designs and patterns, sharp focus, studio photo, intricate details, highly detailed, by Yuheng Jiang

[@sedetweiler]

I will give it a whirl!

[@FilmFactry]

I've got some amazing results with K-Euler and ddim.

[@garypace3587]

any chance you could do a tutorial on creating your textures been looking around and yet yours seem so creative and could with my own images.

[@sedetweiler]

I might, but I do sell them. So, it gets weird 😂

[@MrLaura34]

beautiful!!!!! i LOVE! , but I can not pay more in colab google is not free! ,,, how do you use automatic!1111?

[@sedetweiler]

Video just posted yesterday for you!

[@Kyus2001]

Have you seen the VR aspect ratio? It's out there

[@sedetweiler]

Can't wait to see what is just around the corner!

[@artdehls9100]

Meant to comment on this a couple of weeks ago. Sorry to tell you but noise is noise and your textures won't affect the mood or tone of the final image by much. img2img is great for directing the action though and is one way to get some decently cohesive animation. Try a really slow VFX background of falling snow for example.