Google AI can WATCH & teach you 3D Software! 🤯

[@ZethuMashika]

Matt Damon??

[@DominequeTaylor]

Bro, I thought it was a bitcoin add with Matt when scrolling but glad I clicked on the video because this is amazing info. I got to try this!

[@gtair310]

Bahahahahahahahaa I thought the same thing

[@VFXCentral]

I get that OR Fat Damon! lol thank you

[@dejwidart]

Matt from Mars 😊Bring him home 😊 Great stuff. I think it's a good tool for people who are starting to learn something new. I imagine more advanced support like "I would like to make a car model. Where should I start?". In response, we get steps, references, preparation of the scene. Honestly? I wouldn't want Ai to do everything for me, just show me how to do something. Exactly as you showed in the video.

[@Mikir-Dulu]

meet demon?

[@MikevomMars]

As I started to teach myself programming 25 years ago, I had to order expensive books from overseas and there was NO ONE to ask. Now it is like having an endlessly patient buddy guru sitting right next to you - a dream comes true!

[@Seriouslydave]

Imagine if teachers were this good

[@MikevomMars]

@@Seriouslydave Actually, I am also using ChatGPT to enhance by math knowledge now - something in which my teacher failed so catastrophically at school due to his sheer incompetence and impatience.

[@deckearns]

The crazy thing is that soon we won't or 'navigating' menus (or coding). Instead of asking an application to 'show me how' we will instead ask it to 'do this for me'.

[@MikevomMars]

@@deckearns I don't think that humans won't have to code anymore since AI isn't good enough to do so without human verification yet - but even if it were, it would be stupid of humans not to verify AI-produced code line by line. That hallucination and memory loss problem will always be part of the transformers technology.

[@minos99]

Doesn't work with languages with few github examples eg. Small or New languages. Eg. Nimlang, lobster or packages in languages.

[@sinamathew]

As a 3D instructor, I can confirm to you that AI just took my job.

[@pmlstk]

get gud or learn be a plumber

[@VFXCentral]

@@sinamathew I don’t think so. Your experience and talent makes your perspective matter. Trust me!

[@deckearns]

The crazy thing is that soon we won't be 'navigating' menus (or coding). Instead of asking an application to 'show me how' we will instead ask it to 'do this for me'.

[@slutmagic383]

im more excited when i can do it all with telepathy and ai commands

[@dacentafielda12]

I was planning on giving this a try today. Last night I played some games with it. It really feels like you have a personal tutor for anything you're doing on screen now. What a time to be alive!

[@mash3d67]

Ask it to explain Geometry nodes in Blender. That would be an interesting test.

[@jendabekCZ]

@@proceduralcoffee Maybe G. Nodes in Blender aren't the best in the world, but definitely useful and powerful enough for 99% users, especially in the recent Blender versions. I would be also curious to see if this AI could understand some more complex setup and give some advices (I doubt it). But for teaching basics it could do the job.

[@asvind.v.a4326]

You can learn geometry nodes using chatgpt using text prompt I have learnt a lot about geonodes

[@inkoalawetrust]

@@proceduralcoffee Then I can just tell it to ask Google to wire transfer me several thousand dollars to buy Houdini.

[@effectatron]

Let's go! I'm Gonna try it out with ue5

[@IamSH1VA]

How did it go?

[@robinkruck]

​@@IamSH1VA I assume, not very good. But Unreal Engine 5 is best! ❤

[@TheKevphil]

@@robinkruck 3D is like Photoshop, Illustrator, and CAD all rolled into one. UE5 is all that X 2! but yeah, excellent results in the hands of a skilled user.

[@b.a.g2073]

At least it is a teacher rather than replacing the user.

[@macIain]

Replaces teachers though so still replacing humans

[@b.a.g2073]

@macIain yeah that's true.

[@joannot6706]

An AI can click on a screen and can also type in numbers/text to change values. An AI can look at the results of what it did by looking at the screen. So it can and will replace users When it comes to making images or video, it won't use blender, it will directly imagine an image or an entire video inside of it's artificial brain and display it, it'll understand pretty accurately fluid sim/soft+ rigid body sim/light transport sim, inside 1 big software, an artificial brain... But AI does have the ability to use blender. Check out google's VEO 2 for instance.

[@nyomanbandarayani6830]

Meshy, Rodin, and Tripo can do the mesh. But they can't topology and UV mapping. It's been 3 years and there is no AI that can retopology nor UV mapping, even Meshtron. When AI can retopology and UV mapping that's when AI replace 3D artist and animator

[@NotSoMuchFrankly]

_In order to get the right answer, first you must ask the right question._ That's what a good teacher does. If you need to use this more than a few times, you're not learning how to _do_ or how to _be creative._

[@3DJapan]

Been a professional 3D artist for over 21 years. First I've heard of a UV sphere. How is that different from a normal sphere?

[@xl000]

From the Documentation: UV Sphere A standard UV sphere is made out of quad faces and a triangle fan at the top and bottom. It can be used for texturing. This is a blender term I guess this is one way to create a geometry for a sphere and reasonable UV at the same time If you have done some work on the UV, you should know that a sphere have 2 problematic points ( say north pole and south pole) if you try to map it's surface to a uv rectangle ( [0;1]x[0,1] )

[@EmreAy-v1c]

I'm wondering if data is also being collected here to train the AI.

[@optymystyc]

Yes it is. Lol. But I still want it.😂

[@PromptKing]

You already know 🤣🤣🤣

[@mastart4971]

I suppose this is a rhetorical question. 🙂

[@KasiVids]

Why so worried about your useless data?

[@EmreAy-v1c]

@@KasiVids Why so triggered just because people are asking questions? Since I don't use AI tools like this, I'm not worried. You also don't need to make assumptions about others just because your success experience might be deleting cubes in Blender. Artists, who work with VEX/Python code or otherwise handle complex tasks, might be interested in their data because they have no interest in having that data used to train AI. Some of that Data or Setup may belong to their companies and so on, its not about your Donut-Journey in Blender.

[@StevenDiLeo]

It seemed like all your questions/answers could be done via voice chat on gpt without seeing a screen as the questions were pretty standard questions that didn’t relate to something very deep within a scene that would require much visual knowledge

[@simonkleitsch3394]

I agree. Would have loved to see more specific examples here.

[@TahmidYaasin]

Yes but that's not the point here. The point is AI will be taking over soon. The master techniques you are talking about, those will not take time for ai to learn I think. I hope I'm wrong though.

[@adameskoo]

@@TahmidYaasin It is a point here a little bit, because he used Google AI Studio with screen streaming option so it would make sense to test it with that in mind. It would be great to test it for some basic troubleshooting, problems with non applied scale, flipped normals or something like that. As Steven said - all that interaction could have been done with just a voice chatbot like chatgpt used from a mobile phone.

[@hoodboyslim]

Ai does not know whats cool

[@AndresArosemena]

yeah, I tested this with a landing page I did and wanted feedback from the AI. It was very disappointing. It "saw" the landing page as a whole but it hallucinated almost all the text. Started saying to change text that wasn't there.

[@raymobula]

This is brilliant. Add an existing course to it via RAG and you have an amazing coach.

[@MarcinDiering]

Omg.. Online courses are done now. Learning Blender with this is like a dream come true to me. Instead of searching for tutorials all the time I can just ask computer what to do :v insane.

[@youMEtubeUK]

What it needs is for it to dial up some KZbin videos on the subject as knowledge and then it guides you on how to do it from the information in the video. If it could point on screen or even draw or show concept diagrams would be good. It could also put in break times and resume another lesson on another day or schedule it in your calendar.

[@j0shj0shj0sh]

That's a great idea. Tell Google this!

[@RockBottomsDevilsSlide]

Yes I was thinking that if it had a drawover function which highlights or displays an arrow to the area it's talking about, that would be a big plus.

[@danieldonaldson8634]

Having built courses teaching Blender, software coding and with a fair amount of experience uising AI in coding and systems configucanion and integration, I would say this is impressive. But the consistent pattern with AI I've seen is to have very high utility in basic stuff - and this is very basic stuff - but to really fall apart when it gets to more real-world problems that people learning and creating face using these complex tools. The reason is basically, that AI can only deal with tasks of limited complexity, and doesn't have a larger contextual grasp. That's in turn because AI of this type is basically a compendium of massive amounts of disparate data that tends to converge around a single goal. So, recently AI was shown to be really good at predicting the outcome of proposed research, in part because the answers are already there in prior research that people have done, but no-one has correlated with each other. In this case, the ability of AI to synthesize the design and aesthetic goals creators have seems like a lot more difficult task, because there's no support material for it to scan. The other interesting thing to know, is how is it learning this? I suspect that the way it knows this is because it has integrated the manuals for Blender into it source references. A manual won't tell you how to do the things like get a better retopology, or deal with complex textures.In the meantime. companies like Google with major AI projects have to be very careful about the emergence of perceptions that AI might not be all that is claimed, since that has the potential the crash stock prices. Basically AI is likely to be a giant pump and dump scheme: things like this are part of keeping the price inflated until the original investors are covered.

[@TheKevphil]

I wonder if this is a job for an *AI AGENT* that can follow an algorithmic _recipe_ to get someone from point A to Z, essentially having a back-and-forth dialog with the user. Something else, on the way to creating a fantasy jet engine, is starting with a cylinder and adding "stuff" to taste. And so on. Such a "helper" might best be incorporated into a full-fledged "helper-bot" that also warms up your chili-mac. So I guess I won't hold my breath.

[@tianalucas4969]

aww. Poor thing thinks "AI" is like Office 2007 stucked in a Pentium 4 computer. 10 years ago ppl said AI is just bunch of If Else statments, Now saying this, I'm sure in 100 years bird brains still complaints it can't turn mud into gold like our ancestors.

[@czkid54]

very cool, but how do you set it up? Does it work with Unreal Engine 5?

[@movietrailersvfx1318]

this is wild

[@marknunya3107]

That’s dope. Does this work with unreal engine as well? I use both.

[@theKingsAmbassadors]

Exactly what we need so that it learns by us doing so that in a few years we are gone out of the jobs. YAASSS

[@jon_patterson]

I thought the AI was going to highlight on the screen where you should be clicking... that would be next-level! In any event, thanks for the vid.

[@EchoYoutube]

This is really helpful, but I think when they specifically train and tune the model to have more human-like communication(especially improving the context awareness and the memory, while also fixing the streaming crash) this will become a must-have tool for all purposes of life. Edit: Project Astra is pretty much the thing I'm describing now that I think about it.

[@Mettsemmel]

Interesting! I wonder how well it works with questions that are much harder to google or with things like "why is X not working? What do I have to change to make it work?"

[@supersupersocco]

Awesome! Have you tried it with other software yet? Nuke, Houdini, UE etc

[@xonx209]

Great, but I wish google makes an AI that watches what you do on your computer and warns you if you do something risky, like engage with a scammer, or click on a suspicious link

[@AndyRedwood]

So you'd like GOogle to watch everything you do on your computer screen? Yeah, absolutely no flaws in that idea (:

[@piyman]

I tried it. It says , it can't teach complex software.

[@graphguy]

This is a good start. But need it needs to quickly get to where it can interact and not just direct with application requests from the user.

[@joshuaking1291]

Wow! Just wow! How do I get this?

[@Seriouslydave]

I watched a blender user tell ai what to do in blender and the ai did it for him, i understand the value of teaching but i thought it relevant. Polyfjord deep dive: controlling blender with my voice using an LLM.

[@ReynanteMartinez]

This is wild indeed! Finally, an AI tool that I can be proud of. I hope it gets more development to be as intuitive in Houdini as it is in Blender.

[@pascalcreativedesign8790]

Do you use industry standard keys? Does it work week with Google studio training?

[@GrannyGarrett]

So is this a feature in Gemini Pro currently, or is it just some kinda open beta?

[@Romssav]

Dang, this is wild, kinda scary but kind of amazed aswell, thanks for sharing man!

[@Possessed_Owl]

That's awesome! Does this support other 3D programs? Like UE?

[@MarshalArnold]

That is wild, I wonder if it works with any software out there? Or only trained on spesific titles.

[@GalaxyBigBird]

Wow..Having Matt Damon teaching me how to use AI so that AI can teach me how to use 3D software certainly wasn’t on my bingo card this year 😳

[@Carbide-1]

Thanks for making this video, I'll definitely be looking into this! Google are tearing up trees right now, providing loads of super useful AI tools, exciting times indeed.

[@CapitiStudios]

I had tried the other day and it was so slow, answers would take 20 seconds to show up... is it better now?

[@CapitiStudios]

Just tried again with unreal engine 5... it either doesn't responde at all, or responds, ages later :(

[@trekfuel-p4l]

Man thank you❤ good news about such things like asking ai about functions

[@texasFilmLock2]

Amazing! How well does it work for Houdini?

[@jotoderjosh]

I just tried it with Houdini, and guess what, it can't even guide me to create a normal explosion. So my guess is it still need a lots of development

[@Hi-HK]

@@jotoderjosh My guess is that KZbin is flooded with Blender tutorials compared to other 3D software, which is why it's so good at it.

[@jotoderjosh]

@@Hi-HK my guess is that the instruction is still too simple. I want to see AI guide me through doing retopology stuff

[@joannot6706]

My guess is that it's just the small Gemini FLASH 2.0 model, what when it's the Gemini PRO or ULTRA 2.0 model?

[@ianwatson5767]

​@@jotoderjoshstill who cares if AI generators like Kling, Minimax, Veo 2 can just create VFX by typing them out as a prompt. CGI is dead in 3-5 years for everything except video games, I have no doubt.

[@relaxvanity]

Man crazy outcome bro😮

[@JoshuaMerrill042]

I have been waiting for something exactly like this!

[@HikingWithCooper]

Woah. This is pretty huge. Now if we can have Google take the wheel and actually do what we ask it to, that will be next next level.

[@hobyvh]

This is exactly what I want to use AI for-and even have it do some of the tedious steps for me.

[@shingAMarie]

I tried to use it with Unrealengine, but for some reason, the AI crashes every five minutes or so, does this happen to you also?

[@mfjae]

This I exactly what I've been waiting for... This is crazy!!!

[@An0therR0gue]

oh crap, i might actually be able to use blender now (my fault, I know). I'm coming for you next unreal engine 5, and trying to find out how to do stuff there are no videos on.

[@RhynaX]

This is incredibly helpful Thanks for the video

[@MMMMeeeeMMMM]

We all are doomed

[@KirillPodcast]

For WHAT? 🤔👀

[@Ryan-hz5xi]

IKR! AI is still useless when it comes to medical stuff

[@ianwatson5767]

As a 3D artist for 10 years I don't even bother with 3D anymore. Why learn VFX or how to render/animate things when an AI image/video generator can do it, or teach someone else how to do it on the fly. Plus AI is generating 3D models now too. In 3-5 years CGI will be completely outdated

[@wellheytherehihowyadoin]

As someone learning 3d I'm not really descentivized, But I do think that this will cannibalize like the bottom 3/4 of the market that are just going for fast and cheap. if AI is pulling the rug on 3D as a viable source of income where does that trend stop? I spoke to someone who did programming for maxon and Cinema 4D. He said that more and more of what he was doing was becoming automated and he made the switch to becoming a first responder doing EMT work. I think this was aided by the fact that everyone in his family were first responders and so The path was demystified. If something as complicated and nuanced as animation is going to be undermined by Gen AI seems a lot of other tasks and industries are going to be on the chopping block too. big changes. I think there is still value to learning 3D because it is so difficult. It still demands hella problem solving skills and requires a lot of experience to create anything worthwhile. I can get cliff notes from AI for most books, But the value is still there in reading the book. For the individual... For society that increasingly only values speed and cheapness at the expense of quality or accuracy... Iunno? How the hell any of us are going to earn a living with all of this convenience beats me. We've learned the same lessons from the tech industry "improvements" time and time again Blender is rad though, so I'll continue to learn it. I'm also learning to work with my hands with carpentry. Obviously I'm extremely privileged to pursue either of these things.

[@aijokker]

By WE you mean youtubers that tries to sell their useless crapy online courses that teaches nothing?

[@unclefunkdrew]

The Bourne AI-dentity!

[@SirTodd]

wow this is absolutely insane and so cool. im seriously blown away

[@derekthemagician]

How ya' like dem' apples! (another matt reference) great vid!

[@Ernzt8]

This tech is moving fast. So helpful!

[@AndyMcIntire]

Is this possible with other software or only because Blender is open source?

[@MrSnacko]

It seems several of the links in the description are broken. I was just trying to figure out how to check this out. There's so many links I'm not sure where to start.

[@canonical5]

Can it talk you through / teach Unity or Unreal Engine?

[@rnyt201]

WOW! This is very impressive. Thank you for sharing!!

[@12yfilms]

Wow this is amazing! Thank you for sharing!

[@martina_verde3D]

as everyone says, yeah, this is very cool, but, it is also info you can get very fast anywhere lol I think it would be useful like for someone that is just starting with a soft (and already knows how to 3D). Everytime I had a very obscure problem with 3D the only solution was asking around, usually sometimes even offline or in private servers, there is a lot of secrecy in this field, so it is no surprise that AI doesnt know many fixes to some problems, bcs there is no info about it out there

[@waritebouayyad]

Does someone tries something more complicated rather than throw a sphere in the scene ? like modifying the animation parameters to achieve a kind of special thing.

[@dailydoseofshitpost751]

it probably cant

[@DeanClark-g6y]

Sounded pretty sarcastic when it said 'uv sphere'. Just a matter of time before the mundane pushes them over the edge and they are killing us in our beds.

[@VFXCentral]

@@DeanClark-g6y bahahaha! Yea the voice sounds a little snarky

[@zch7345]

Awesome review buddy.

[@Stranger-games]

I just tried it out, the AI can't really see or analyze the screen. The screen sharing functionality is limited for other humans collaborating. That's the AI's answer.

[@EsteroBustamante]

Incredible my brother!

[@Robert-uh9vf]

I just tried this on my own computer, and i don't know if it works as well as you make it seem. its almost as if sharing my screen doesn't do anything, and the instructions i get from gemini seem like they're from an older version of blender.... or i'm just stupid. I don't know how to use blender at all, and I'd love to make a 3D model or something for a game.

[@IrishMerlin1]

Question though.... what if I'm deaf? How do I go about using this? Is there a way that I can type in my question and AI responds in text instead of voicing to AI and hearing the response?

[@rayrayjnr5724]

One of the motivators to keep going is the sensation you get when you make progress and not just having it handed to you incrementally. When things start to make sense and you build a tolerance for the technical aspect of what you are doing, this goes for almost anything difficult in life. This work will become less satisfying and commercially have no value and originality through simple excess supply. They are ultimately trying to claim your lifetime wages and determine who and what has value. A wave of AI creators awaits us on the social media monopoly to further displace all the people that have been pushed aside so this paradigm can succeed, and we will be a few steps closer to a society that cant escape corporate culture. We will all end up unessential workers so the stocks can keep providing returns to the people that preferred an anti social internet.

[@ivanraimi5524]

Sam Altman and Zuck are two antisocial weirdos, who grew up isolated without any friends. of course they want us to be replaced by AI and live in the metaverse, buying nft's with crypto currency

[@EchoesofEgypt]

Noice Is College really the moves now?

[@theKingsAmbassadors]

Ok so we are now the machines and the robots😂!

[@rasserfrasser]

hehe...what? this is amazing. I might actually learn Blender now. Thank you!

[@Arunnesar]

I'm facing an issue with Gemini. Whenever I share my screen with Gemini, it works fine initially, but after a few minutes, it suddenly stops responding. Is this a bug affecting everyone or just me? Is there any limitation like sharing the screen for more than two or three minutes?

[@thegoodnewsguy158]

Sure, share your screen. And google will take all your ideas. It’s never been easier for corporates to take ideas/designs. How do you protect your IP with AI.

[@alexalexis7899]

See, this usage makes sense - it is not doing stuff for you, you have total control of what you are doing and it actually streamlines the process of understanding and learning what options you need to use to achieve what you want. Imagine the countless hours people spend either going through KZbin until they find what they need or passively sitting through paid courses being directed into learning and creating.

[@CGMatter]

goodbye cgmatter

[@kruz3d573]

#CGMatterLifeMatter

[@r_dva3301]

goodbye entire cg industry

[@jdcmsigma47]

awesome video man!!

[@afrotron]

Look good so far. Hopefully it would be useful for more difficult tasks

[@Creathrod]

Cool 😎

[@pascalcreativedesign8790]

I'm excited and freaked out all at once. 😮

[@hectorescobar9450]

This is how AI should be used to actually help and empower people

[@PromptKing]

The problem was you weren't in the pre render or the final render mode

[@bobhawkey3783]

Holy Sh*t. That's all I've got. Thanks for this. Wondering if it supports Unity.

[@AndyRedwood]

This is really interesting, thanks for sharing! Probably worth noting though - AI is (and will continue to be for the foreseeable future) an incredibly power-hungry beast, both to train the models and use them. Using it to learn software has to be one of the better ideas, but if we start using it in place of a (sometimes very quick and easy) Google search for the answer every time, it's going to add serious wattage to the already excessive amount that AI uses.

[@Waqulah]

You mean the same google Ai that verbally abused its user? I do that well enough on my own. 😂

[@bellyfluff101]

So good - thanks

[@JR-zd2nm]

This is great, but a lot of KZbin educational channels might go out of business, I don't know, I think it's getting scary.

[@r_dva3301]

tutorial no need, just ask AI to help make something, model or other stuff. It seems like anyone with zero knowledge can go to any 3D program and make assets or other content with AI help

[@atoaster2070]

Not likely. This is mediocre at best. Actual human instructors won't be going away for a long time, hopefully.

[@ramanandh1261]

You are coool Guy!!!

[@karibaevulan]

I have some thoughts about this. According all the data that collected by Google. Ai models can implement 3d software right into the neural network itself. And you have to be scared of it. Progress is moving forward tremendously fast. 😮😢

[@jason_dube8702]

Ya that’s insaaaane

[@MatthewHinmanTexas]

Too cool. Too cool.

[@garagaracodm2874]

but unfortunately, after couple of conversation, it'll crash and saying something went wrong, and forced to create new session

[@kingsridge]

So essentially: Blender + Chat GPT + MS Recall, for training purposes.

[@auricgoldfingers]

I think the version I got was a bit dim-witted. It had no idea how to make 3D text in Photoshop and how to apply surfaces and colours.

[@coreyblack5]

This is pretty crazy.

[@personalwatching9312]

This is nuts. Also, ai sounds like it's been drinking way too much soy.

[@ArchiDesign-d4w]

wow I ❤ it

[@babacartoure8120]

YES good, it will can help

[@edwardparish6621]

I'll be cheering the day it will sculpt for you based on a photo or video of a sculpture or body.

[@mphillipsphotography7013]

Thats amazing!

[@ScaryLasers]

Hell yeah blender is so much

[@chumioCharlie]

This is amazing! But why even learn anymore? when everything will be created for us. I like to edit videos in my spare time as a hobby for family, now every time I upload them an edit of a family gathering i always get in the comments, from family members. "Was this done with AI?" and when i answer no! i get, "Why Not?" 😕. Don't know where this is all going in the next couple of years but it is still very exciting.

[@YuriIdrisov]

Hey, did I just hear that bot adding inhale sound to its speech? Whoa...