A.I In Blender is Awesome!

[@gamefromscratch]

Links gamefromscratch.com/dream-textures-stable-diffusion-for-blender/ ----------------------------------------------------------------------------------------------------------- *Support GFS on Patreon* : www.patreon.com/gamefromscratch *GameDev News* : gamefromscratch.com *GameDev Tutorials* : devga.me *Join us On Discord* : discord.com/invite/R7tUVbD *Twitter* : twitter.com/gamefromscratch -----------------------------------------------------------------------------------------------------------

[@sburgos9621]

How about using the AI to create the 3d model itself? Are we at that point yet?

[@sburgos9621]

@@DelanaMcKay With the level of technology today that should be possible.

[@LudvikKoutnyArt]

It's a cool tool, for sure, but still, you are using Blender wrong. You should have deleted the default cube and re-added the very same cube.

[@bean_mhm]

@@UnderfundedScientist r/wooosh

[@roywilkinson2078]

Correct. For Blender to work properly the default cube must be sacrificed and then resurrected whilst murmuring "ecruos nepo" under your breath. It is written.

[@TheTenebraX23]

@@UnderfundedScientist cringe overused sentence

[@IronKore]

This cube survived the abyss of cubes

[@MrStarnger1]

@@UnderfundedScientist bro missed the joke

[@nocturne6320]

The reason why the results don't look that good is because the result depends on your viewport position, if you're too zoomed out the result will be too low res for the model, also depending on what angle you're looking from. Another feature to consider is generating using a depth map, as it improves the result significantly. Also the results depend highly on the model you're using, prompts for the cobblestone texture were too simple, SD 2.1 requires a more detailed description of what you're looking for.

[@KiR_3d]

make your own tut, you can hype on this topic.

[@magistrcooldayn233]

If you would make a full tutorian itll be nice

[@violettracey]

Thanks!

[@FuriousImp]

Ditto. Would like to see your tut on it

[@domachondri]

closing up on the AI bot's crotch for the transition was crazy

[@guns1inger]

If you are using the 2.0 or 2.1 models then you should be using a base size of 768 x 768, as this is what the model was trained on and is the optimum resolution. 512 x 512 is for the 1.x series of models.

[@dreamsproject3355]

I always make the default cube a hero!! Even though AI is quite powerful, I still feel like it takes away a learning curve or skill check or the experience-builder that is required for these kinds of things to improve an actual artists skills... but of course many people can jump off this to get a boost or quick projects done, but I feel it takes a lot away from the personal aspect of unique and individual art at this point, but I have used AI a lot before too so it goes both ways!!

[@ctkrocks]

Thanks for checking it out! For the default “stable-diffusion-2-1” model you’ll get better results with 768x768 images

[@VladyVeselinov]

"The Blender operating system" what a time to be alive

[@StopItRyan]

Definitely a cool tool that I am going to use immediately. I have already been using MidJourney for image generation. I've used it mostly for floor and landscape textures in Unreal Engine, it can make some very unique designs, one of which I actually did a little bit of touching up to in Photoshop and it might make it to the final version of the game. With AI as a concept though, I am pragmatic about it. I understand that it is concerning but, the genie is out of the bottle, at this point all you can do is learn to use it. Complaining about it and not learning to utilize it won't make it go away. I feel like AI to millennials is computers to boomers, some boomers decided to embrace it and are better for it, while others pretended they could live without computers and have effectively made themselves unable to operate in modern society.

[@zerbs25]

I think A.I. open source is the future. You teach your own A.I. to assist you in your work. And create your own tools and applications to work with. And the best ones you share with other people. The time when we waited for developers to come up with solution is over. Now we make our own solutions, we are the solution.

[@NeilRoy]

Very nice! For those of us that are not so artistically inclined, this will be a big help at least in prototyping and maybe more. I can definitely see this improving to some amazing levels in the future.

[@sim2g]

Generate by frame is to use is in animations. It is updating the angle of mapping as angles of preview change.

[@aumhren3480]

05:18 - this is the most beautiful flawless texture ever created in this universe. thx for sharing, have fun

[@m1k3droid]

the generated texture isn't seamless on that cube because the default cube is given skybox mapping, not tiled mapping. You need to edit the UV map to fix that, possibly remap as lightmap packed or a standard unwrap

[@FulguroGeek]

You can generate 1024x1024 image with the addon, its just because its set to 512x512 by default but you can go up to 1024 and with the upscalling you can get your image 10 4096x4096

[@nochumbrummel5276]

At 4:29 obviously it's not going to be seamless because you're looking at it on the cube which depends on how you UV unwraped it, but if you would take the 2D texture and repeat it on the XY plane it would be perfectly seamless.

[@markirwin3624]

I hope they get something similar to mid journey eventually. It's a lot better for people like you and me.

[@JonLynchIsAlive]

Wow, this is impressive. This early demo may not be perfect, but imagine what we'll be able to do in another 5 years. Things are changing very quickly.

[@tiredlocke]

Exactly. That seems to be lost on a lot of the detractors of these new AI solutions. Do they threaten traditional jobs? Absolutely. Just as digital artists replaced hand-drawn artists in many industries because it is faster and more flexible while many traditional artists cried that digital isn't real art. Artists who can work _with_ AI tools will likewise thrive as the AI tools will help improve their workflow and output.

[@HaseebHeaven]

Wow this is game changing for Developers and Artist

[@darkside3ng]

just amazing!!! In future this will help so much the production of environments and characters

[@denizorsel1029]

I guess in 10-20 years time , we will have UI free Blender where we will talk to AI avatar to create anything. It is already fascinating to see the capabilities of the AI and its implications. By the way, as much as I could try prompts on several platforms it comes to the video ram size where the resolution is capped. Of course the training resolution is important but it doesn't limit it. And unfortunately none of the current outputs are production worthy but for mere testing prototyping.

[@flex4285]

Hopefuly youre wrong

[@dave3269]

In 10-20 years time you won't even be talking to the AI, it'll be telling you what to say.

[@denizorsel1029]

@@dave3269 I am not but I am. I am not . I am. I am not . I am . Scary stuff.

[@MKHideOut]

Use it for individual textures, works flawlessly

[@TriangleHarder]

The good thing is that no matter how much technology helps non creative people make things it will never make them more creative and that's the only good part of all this.

[@LightWorkerBass]

Facts

[@Bulborb1]

Facts x2

[@ayoubbelatrous9914]

you don't need to be creative if a computer can do it for you.

[@TriangleHarder]

@@ayoubbelatrous9914 the computer is just mimicking what an actual creative person would do with ease. And I'll repeat again. It will never make them more creative. Not sorry that this is hard for you to understand. maybe an AI can explain it to you though.

[@ayoubbelatrous9914]

@@TriangleHarder AI doesn't imitate it learns same way a human learns but much faster and cheaper. it wont make a person creative that is true. this is just the beginning wait a few years until is get advanced enough to the point where even the best artists wont be able to compete and even if they are able to compete it will be cheaper faster and better than most artists. you don't need to be good at art to accomplish what you tryna do is what am trying to say.

[@karolkunysz8474]

Wow ! nice but what about styling a set ob objects with the same style ? Every object will be textured alone with no connection with others? Keeping the same style for multiple object is a pain isn't it?

[@ukrsolid]

My suggestion will be to add tool name in title of video for future search

[@aybee5908]

Nice to see. where this leads to. But in this technical status I`m (still) not convinced to use it. In the time I have satisfying render results, I`d textured it by myself.

[@biljamoraco877]

Hope have something could do recreation from my messy mesh obj model to blender model, so I could have more control of the bevels and sub-devision of my model

[@MultiMam12345]

3D Artist + Blender + A.I.= 🤯

[@keterbinah3091]

its an aligorithm basically googling images stealing them and tweaking parameters . i was hoping it would generate raw textures from scratch, perhaps substance painter will master it in future .

[@artemaung5274]

I don't quite see any benefit of using it as a blender plug-in yet. Projecting depth "texture"? Useless. Generating 2D textures? Automatic1111 works just as well including seamless bit and a wide variety of memory options and upscaling. I can generate 1024 textures natively with -medvram and do a single upscale to 2048 with 768*768 pieces on a 3080. If I had 24Gb GPU I'd be able to do even better. One thing that was nice in this implementation is nice categorization of prompts - ie "close up shot", "Full color", "long exposure" etc, instead of a very long list of carefully crafted prompts in automatic1111.

[@Tallacus]

awesome, now if they were to add a ChatGPT that will write out all the custom tool creations you need

[@stonemass3569]

super cool i hope we can do 3d models soon !

[@oblonggong]

there are some 3d model generating ais actually, they arent too good with topology but at least its something

[@pescadorCardoso]

This is great. I love playing around with stable diffusion it's addicting. Btw, your generations were really bad because you're basically using bad sampling methods and even then not enough steps for them. With DPM++ Karras you can use 15 steps and get really good results. Set CFG to something around 9 or 10.

[@gamefromscratch]

Ah ok thanks, will look into that. One thing I have found with Stable Diffusion is its REALLY easy to look it up or make it hang when you play with settings, so it's made me really hesitant to experiment

[@jondesoo8055]

One does not simply celebrate that an entire profession which created the art and entertainment we love since forever is risking going jobless. I'll not be that ungrateful.

[@monikabober7290]

wow!

[@amolbook]

a Thumbnail could have said - Mind Blending..

[@anettebianca6855]

love ChatGPT - this will be fun ;)

[@badcatzgamedevelopmentcomp4808]

CAN YOU, make a bunch of blocks, select them, then texture them all as a City?

[@VincentFischer]

Couldn't you change the texture clamping/repeating mode for more seamlessness?

[@OnyxIdol]

this could be very useful when you're just sampling parts of the generated texture to stencil.

[@S9universe]

hello do you know how to make the upscale ai works please ?

[@tiagotiagot]

"Seamless" only considers tiling. It has no access to the UVmap or geometry; the cube edges and corners would only look right by luck.

[@kleioscope]

LOL !!!! Playing loto in blender 🤣 Push the button and see if you won the 1st price !!!!! The awesome-texture-just-fitting-your-dream-and-it-is-seamless..... 😂 All those who won played at it ! and YOU will win ! ( provided you have eternity in front of you ) okay this is really amazing :D Now please, go to Blender artists and post a WIP done with AI textures ;) I'd be pleased to discuss about it ! Happy blending ! EDIT: oh and don't forget to ask AI for AO, height, roughness and albedo :P hehehehe

[@cynth4941]

Can you use custom AI models on this thing? Like say I'm making something anime-style, can I put AnythingV3 or NovelAI instead of Stable Diffusion there to generate the textures?

[@gamefromscratch]

You have the ability to upload your own model, so I assume the answer is yes. That said, the details of making models is beyond me.

[@violettracey]

Cool!

[@rewindcat7927]

The Norman Rockwell house looks like something from Hello Neighbor

[@XtremeZero]

Gonna wait for someone to create geometry node AI that does modeling, texturing, and animating for me 😂

[@sicfxmusic]

I'm making a AI called "Father" than can run your family without you. 🤣

[@Blagotebi1]

chatgpt can apparently write blender python code, albeit not perfect for now. At some point it may be able to create some generative geometry for you. It is still good to understand how the blender python scripting works in the first place.

[@luigisake]

you could probs use an ai image upscaler to upscale the texture.

[@carlossoares712]

awesome

[@daan3898]

Just Scary.

[@ThePineTreesBand]

Wow. I remember a time when it used to take longer to load a single image on dial up internet. And it wasn’t even generated by an ai…

[@FateOfLyan]

is there a way to automatise the iteration more? Like tell blender to create 10 or 100 images in a row ?

[@Katejsej]

It is really unnecessary at the moment, there are way better ways like we model and texture for years. These methods are on a top peak of quality and easyness. This copyright theft AI is nothing.

[@surfernorm6360]

Gamefromscratch Hey I liked what you are showing except you move way to fast for me. Also you should use the screen keys mod that is available so viewers and follow more easily. Also Norman Rockwell is a drawing style not architectural style gothic greek new england santa barbara bungalo, mission style would be examples. the AI looks like it had seen an abandoned house drawn in norman rockwell style. thats all glad for the heads up about modern texture. c heers

[@mastermill79]

This is amazing.

[@alexgram4345]

Is it only for texture or can it create objects as well ?

[@projectirreverentgames8517]

Yooo, I don't want to say I told you so but... Theytook'ourJoobs!

[@IamSH1VA]

I was so excited then those horrible cobblestone results 😂😂😂

[@DJ_BoomBear]

Ok ai needs to chill out on my fields. This is getting ridiculous

[@johanngambolputty5351]

I never seem to be able to get the same quality as what other people do with stable diffusion, maybe I'm just not using the optimal parameters, though I guess more like its the trial and error nature, you need to take a fair few samples and on my gpu it can take a little while...

[@actk1]

Don't know why it doesn't work for me. Using Blender 3.4, download free version for AMD GPU but it just doesn't work. Can't use search for model because it doesn't appear and it show that the add-on is not complete. Why?

[@kand016]

nice

[@gricchastain6506]

Awesome...

[@notsure1969]

It's a very cool idea. I'd like to see where it goes.

[@johnhershberg5915]

What we need is a tool like that to generate animations for characters. Most time-consuming part IMO

[@somedude5951]

Cascadeur does this.

[@johnhershberg5915]

@@somedude5951 But not by prompt right? You still pose and animate as usual, and it completes it via AI?

[@somedude5951]

@@johnhershberg5915 Yes. Mixamo is closer to using a prompt, but that is not AI. Rokoko can also make rigging and animation faster, you can use there video's of yourself posing for the movements.

[@TheDocPixel]

It’s coming. Animating by prompt will be HUGE. Run to point A, stop look behind, pick nose, turn back to front and run over the hill…to the future.

[@beanpole4701]

how well does this work with character models?

[@tlilmiztli]

Probably just as "good" as with this simple low poly house...

[@viniciusvieira8651]

I tried to reply with a imagur link to my tests and seemed to not work so I'll just keep it short and say it's wonky but it does work, a bit better for faces than for body, some types of models work better than others, it does take your vertices in consideration after all so a well organized mesh is recommended. I got some very cool results, and you can always edit/clean them up later.

[@Zeropadd]

😎

[@johnsykes3526]

can you use the new shape scutoid?

[@DonChups]

Abstract color and texture mixing is the only use of Ai I'm interested in, right now. But I've got too many ethical reservations about Stable difussion and all the other image stealing databases. I'll wait until someone makes an ethical public domain database.

[@MrERJ1992]

Or just buy Substance Painter(Steam version).

[@meshowzq1430]

These AI stuff is taken over the world, feel sorry for all the professors in universities asking students for 1000 research papers, or all the concepts artiest around the world, all the pro programmers .. ets .. now Ai can make their work sometimes even better and in many many verities and won’t take them seconds.. and the scary thing is that this is just the start.. imagine 5 years from now when the Ai become even way more smarter… ppl can have the full knowledge of how to make Nuclear..

[@lyh1]

You cant just skip baking UV, need to do UV manually if you can look around the object...

[@FilipCordas]

That starting zoom was just wrong 🤣

[@chaver28]

i don't know why but dream doesn't show in my 3D view... maybe because i got mine from blender market, anyone have the same issue??

[@weirdscix]

You need to have the image editor open to view the Dream tab in the n-panel

[@renatocann5142]

You seem like an awesome guy and I hate to go negative but it sure feels sometimes like "games from scratch" becomes a less and less appropriate name for this channel.

[@nocturne6320]

This quite literally allows you to make a game from scratch

[@dragonwarriorz1]

I would love for Mike to make more tutorials. It's why I originally followed his channel. He's a very good teacher.

[@gamefromscratch]

Oh that shipped a very very very very long time ago ;) GameFromScratch was actually the name of the blog from well over a decade ago. The intention of course was to document the creation of a game from scratch (well duh). Then I started making more and more tutorials as I was exploring tech, first tech like LibGDX and later SFML, then engines like Godot. At the point I started the KZbin channel, it was to create tutorials to supplement the website, so I kept the same naming. ... and years later, here we are.

[@cucciolo182]

I’m just waiting for text to video And From normal video to avatar video 🤓

[@jchx767]

luckily this is unprofessional

[@Lubawaandme]

I AM DEMO-VERSION MYSELF

[@The-Sentinel]

is there a way to use AI to create meshes and objects (like the house object)? i think that would be the coolest feature.

[@gamefromscratch]

In Blender, no, I dont think so yet. That said, there are a number of AI based 3D model generators in development, from NVIDIA, Google and others.

[@nocturne6320]

Not that I know of, but there already were experiments with textTo3dModel and the results were fairly decent for a first attempt. I also saw some textTo3dModel magic in UE4 realtime demo, but the results were very basic and without textures. However stay tuned, I don't doubt we will be seeing some generators soon

[@grahamcrowe9701]

You can get ChatGPT to write a python script that creates a model in Blender.

[@DisturbedNeo]

Magic3D (Nvidia), Point-E (OpenAI) and DreamFusion (Google) exist, but aren't publicly available. I expect we'll have something we can play with soon.

[@somedude5951]

@@gamefromscratch Yes, AI can already make Meshes in Blender. I saw a guy on KZbin using Point-E in Blender. It works, but the results are terrible. The results on creating meshes and animations in Blender using Chat GPT look a lot better, but I haven't tried that myself yet. The KZbinr that uses Point-E, also explains how to do it. His name is Blender Smoothie 3d, his video on how to install the newest 3d generator in Blender is named: "How You can run Point-E and create any 3d object for free !?"

[@Uhfgood]

Does it work the computer too hard? I don't have a super fast or modern gpu and my cooler isn't that great

[@qpaoziwu]

AI are usually cloud based

[@nocturne6320]

@@qpaoziwu This is not, it's running locally

[@nocturne6320]

I can generate a 512x512 image on my old GTX 960 in ~30 seconds. But you also have to consider VRAM being a limiting factor, Blender+SD running together can clog it up quickly.

[@igorthelight]

Please improve your cooling - it's important for your PC longevity ;-)

[@somedude5951]

I've stopped using Stable Diffusion locally because of that. Use it a lot from rendering prompts the web though. I think in this video, there was also a cloud option presented, using a Dream Studio key.

[@MarcV_IndieGameDev]

Soon it'll be generating 3d models. That's going be cool!

[@pescadorCardoso]

There's already Magic3D from Nvidia. So the tech is there, we just don't have a convenient UI for it like we have for pictures generated by Stable diffusion!

[@MarcV_IndieGameDev]

@@pescadorCardoso I'll have to check that out.

[@marek_tarnawski]

So you generated 3 cobblestone textures that look like trash? Really powerful addon :)

[@gamefromscratch]

To be fair I'm really really really really really bad at AI prompts. Like... Really. Bad.

[@tlilmiztli]

@@gamefromscratch Come on mate, you say what you want. Youre bad at... talking? :D

[@binyaminbass]

I agree. But it is an idea of where things are going...like most of the AI out today. I wouldn't use any of them in my work (except maybe Midjourney). But holy cow, what's gonna be in one year?

[@Kurabiye.Canavari]

Is it free to use this program completely, so can we translate images as much as we want?

[@fourplenty]

Cool stuff

[@KiR_3d]

10:50 - no! even as a background it's a trash. Maybe there are some parameters to generate it longer but with much better results? It's definitely didn't took all the important 3d details as the information about "what house it will be".

[@Vatecl]

16 minutes of nothing , wass of time

[@DandeDingus]

would be cool if stable diffusion wouldnt have build almost their entire database on stolen work. Skim through the social media channels of big artists, especially illustrators and a LOT are against it and have even seen part of their signature and past works on stable diffusion generations, all without compensation. So yea, using SD in blender if you want to actually make money with it, is copyright dubious at best and also exploitative of the artists who build its database against their will. Cool thing if it was ethical, but sadly it isnt

[@salvadormarley]

Considering all the error messages i get when I try and install it, I consider it a complete waste of time.

[@amalyshok]

Absolutely useless tool, but thanks for review

[@dwgauntlett]

Seriously underwhelmed. It’s a cool add-on but your results were nothing close to mind-blowing. It seems like you were rushing to put out a video before anyone else instead of completing something interesting and then make a video of that.

[@junweidong2448]

It would perfect if there is an AI 3d modeling plugin. Yes, especially human modeling, which is quite organic and there are various styles.

[@cartsin4787]

were all gonna be replaced, lol but this is cool though.

[@Harrzack]

Great info, but why you have to babble do fast? Are you being timed? It seems so many tutes are done a break-neck speeds… 😶🙀

[@historish165]

i wonder if they'll have a button to hide the original artists' signatures on 'your' final texture

[@dragonwarriorz1]

Lol I've never seen real signatures generated by AI before, only squiggles

[@alwaysyouramanda]

No.. way

[@branidev]

future is bright for people who wish to use it

[@ukrsolid]

nice feature

[@AnKlMa]

This is not how it is done :o You have to delete the cube and then add it again. Blasphemy!

[@leonpijudo6875]

lol so much whinin in the comments "iTs nOt lEgAl" "sToP sTeAlInG oThEr´z pEoPlE sTuFf"

[@ferencszabo3504]

It's awesome! On the other side it's the beginning of the end! Human creativity is fucked! Now we're just monkeys tapping on the randomizer button!

[@soapspangledgames2444]

A lot of people thought the same thing when command-completion was created. There were plenty of people breathlessly predicting the end of programming. It was, of course, laughable, but there was a shocking amount of terror-mongering in the tech press. The same is true of A.I. It will never amount to anything more than another tool in the creative toolbox.

[@ferencszabo3504]

@@soapspangledgames2444 we can continue with the analogy but this time we have no precedence for it! It's completely new,and a valid threat!

[@tigers3748]

Stable Diffusion is a model built on millions of pieces of art ripped from artists without permission. Any one of us does something like that we'd be litigated for copyright infringement. I wish youtube algo wouldnt recommend me crap like this