10 Animation Styles to Try in Luma Ai Video Generator! - Image-to-Video

[@wholeness]

Luma does really good at Pixar because it was originally an image to 3d generator and a lot of its data is based on that, same with the vector graphics.

[@taoprompts]

That makes sense, the pixar videos are really impressive.

[@arthurstockham]

Seems extremely promising! I'm somewhat disappointed that it struggles the most with anime-like styles, which I usually favor. Given how rapidly things progress, I'm eager to see how it develops over the next two months. Hell, probably the next couple of hours. 😅

[@taoprompts]

Yeah, hopefully someone comes out with a solid anime model. A lot of us would be interested in that.

[@NotAJiveTurkey]

@@taopromptsgive it another few weeks. Something should preview or drop.

[@LoopnMix]

You can prompt the camera to stay still or pan slowly or zoom etc

[@KSATica]

Glad I’ve came across your vids. I was wondering why the images would pan out randomly even though I’ve just put in the same prompt 🤣

[@taoprompts]

You can try to reduce the camera motion by turning off the "enhance prompt" box, I also made a tutorial for how to control camera motions with different prompts here: kzbin.info/www/bejne/n2XMpZKEl5Jmhq8

[@Caryson122]

Thanks for your research Tao, it really makes a difference to view it. I was wondering in your presentation of the various styles, are you using the enhance checked or not checked? Did you do a comparison for each style based on enhanced/Non-enhanced. I have been uploading my images and not using enhanced as I found that they follow my prompts and style of my images more closely. Like you, I notice that sometimes Luma turns an image into a cartoon which makes the video unusable.

[@taoprompts]

I have the enhanced prompt checked in this tutorial. It does seem to follow the prompts much better when I removed the enhanced prompt option.

[@knightfallprotocol]

Luma definitely needs to add more settings because I have NO clue what I'm gonna get when I hit generate. Sometimes the image doesn't move at all, sometimes it moves way too much, and sometimes the characters go completely off model, and sometimes it's good. I wouldn't be as annoyed if the generations didn't take NINE HOURS for 5 seconds. (I know the payed version isn't as slow, but I'm not paying 25 dollars a month for four second clips that I don't have any control over.

[@taoprompts]

Hey, if you turn off the "enhance prompt" option on the right side underneath the prompt bar, it helps reduce the amount of motion and the result follows the prompt better.

[@knightfallprotocol]

@@taoprompts but that's just for regular prompts with no image. The image to video generations take an eternity and I have no clue what makes the generations come out good vs jankey.

[@taoprompts]

@@knightfallprotocol Here's a video guide with some ideas on how to control camera in image-to-video

[@frasertomsfilm]

what were your prompts for the other stuff like the western cartoon or pixar examples? Did you just write - girl stands in front of family and talks?

[@taoprompts]

These are image-to-video. The prompts I used were very simple. Like "a boy in a forest" or something like that.

[@reifuTD]

It seem that if you turn off the enhance prompt button it reduces the motion blur and stops the camera from panning out of scene, that least turning enhance prompt makes anime generations look better when you do image to video.

[@taoprompts]

That does seem to work!

[@coffeejazzmusicchanel]

Can you give me a prompt to control the camera? For example, you want it to stand still in one position, only the subject moves

[@taoprompts]

I made a video guide on how to control the camera here: kzbin.info/www/bejne/n2XMpZKEl5Jmhq8

[@coffeejazzmusicchanel]

@@taoprompts Thank you for helping me! Now I can control the prompt so that the camera stays still when using the command. When I add an image and control the prompt to move according to the existing image, the camera still moves and does not stand still. Hope you can help me solve this problem!

[@Living_By_The_Word]

Great video. Thank you

[@taoprompts]

Thank you, glad to know this was helpful.

[@Immix_AI]

Please add prompts to these references. That would be really helpful. Thanks

[@michaelpritchard6922]

I don't think he added any prompts. he generated the reference images and pasted them without text

[@LT-bi9up]

That’s too bad

[@taoprompts]

These are done with image-to-video using reference images. I didn't use any complex prompts, just simple things like "a boy" or "an animal"

[@IfzfifzifKtzfjtkt]

That was awesome

[@taoprompts]

Thank you 👍

[@MattWagner]

Agreed on all. Really need better camera control.

[@taoprompts]

Camera controls are a must have for making serious videos.

[@TheCamelot5]

Я понял , одним русским пришло в голову, воскрешать свою семью , смотреть и вспоминать их живыми. Остальной мир просто экспериментирует с играми и мультиками😮

[@cooliipie]

What are the typing? Mine barely move

[@taoprompts]

I just used simple prompts for these. Like "a boy in an anime", "a woman". I made a follow up video about how to control camera motions here: kzbin.info/www/bejne/n2XMpZKEl5Jmhq8

[@olumideegunlae7906]

I like this boy.

[@deldwaine]

Same issue when it comes to anime. It just pans or tilts, doesn't actually move the characters

[@taoprompts]

It seems like Anime vids are one of it's weaker styles.

[@KidsStories_YT1]

Hummmmm...great

[@micbab-vg2mu]

definitly we need some controle - )

[@taoprompts]

For sure, I think they have some updates planned soon. Maybe they will add in controls in them.

[@pgarza1218]

I will try my own art and be nice if I have 2 minutes of my own animation and be cool file send as slides but or the movement and reads and o I see AI and finish more extended movie

[@taoprompts]

They've added a video extension feature now, you can get videos up to 15 seconds long.

[@chariots8x230]

It looks like Luma really needs some camera controls.

[@taoprompts]

Yeah, you can control a little bit using the prompt, but controls like Runway would be better.

[@chariots8x230]

I hope Luma will get better at depicting anime scenes & nonhuman characters. It looks like it’s lacking in these areas.

[@taoprompts]

It definitely needs some improvement for anime style scenes.

[@BabyFish4Music]

Prompts in Luma, not really good.

[@piggywahwah]

I just finished a vid. Did u try unticking the magic prompt box? I found it doesnt pan as crazy. I had a difficult shot where my soldiers were just doing goofy things. I unticked and typed slow motion, subtle camera movement and it worked ;)

[@ghostape]

kurt russell..nice!! subbed ya!

[@taoprompts]

That's a good suggestion! It does seem to work much better.

[@danishraza8843]

yes, magic prompt is not recommended coz of wacko results

[@RichardmpayiTnway]

Damn i,wish you added your prompts input to see what you wrote

[@MiqoNyan]

Have you found any good prompts guide? im starting to get tried with my free 10 a day trial and error attempts, my game characters and their weapons screenshots keeps on transforming/morphing into different creatures/monsters.

[@taoprompts]

I will add prompts in the future 👍

[@ferisrazer1304]

Yes please ​@@taoprompts

[@723mph]

input the image into chatgpt and have it describe the image and ask it to write your prompt as well

[@Mooooty]

SORA Killer 🤣😂😅

[@angosalvo5734]

Or 3d animator killer

[@taoprompts]

It's hard to know what Sora is really like without being able to get access to it.

[@dyter07]

Thanks for the video. I run into simelar problems with luma. And the pricing is hefty, $30 for 120 videoclips of 5 seconds is realy a lot.

[@taoprompts]

I am experimenting with trying to get better camera controls, I think Luma does have a lot of potential

[@AliSaraIslamicStories]

its not working here.. its take forever to render

[@taoprompts]

Their website is just overwhelmed right now, hopefully they will add more servers.

[@shadrackkiban4716]

I’m getting a lot of unnecessary movements , could u share some of your prompts structure for the image to video animations

[@taoprompts]

here's a tutorial where I show some ways to manage the camera motions: kzbin.info/www/bejne/n2XMpZKEl5Jmhq8

[@voodoochild420ai]

great demo of all the different styles, would love to see some text to vid examples, awesome vid

[@taoprompts]

Thank you, I am planning to test out more prompts soon 👍

[@Comic_Book_Creator]

3d works perfect , flat 2d images, not at all

[@taoprompts]

It does struggle with cartoony images more than photorealistic.

[@nuuttikataja666]

I got a pro plan few days ago. Luma is a dud. Watermarks? No control over movement? It's so 2023

[@taoprompts]

I think they released a bit too early, hopefully they listen to our feedback and add in those changes.

[@Orion047]

can I make videos with luma 1 minute long

[@taoprompts]

No, it only extends to 15 seconds

[@ArcanePengi]

For the anime ones I tested, I added the phrase "The camera does not move" and that seemed to fix it. The prompts help guide the motion you want. If you don't want much motion, just describe the scene. Otherwise you should limit the prompt to a single action, such as "kicking legs", "talking to camera", or "riding bike". Those prompts worked the best for me. "Dancing" and "jumping jacks" didn't work as well.

[@taoprompts]

Thanks for weighing in. Simple motions do appear to work decently in the prompts.

[@1anchit]

So pika is better for videos? Animated movies

[@taoprompts]

I think Luma is better than Pika for most situations including 3D animation. There isn't any video generator I've seen that's great with 2D animations.

[@1anchit]

@@taoprompts Ok, I'll open a new channel with just images as stories. Not sure how to animate the images I have as those are like story for people/kids sort of thing in 2D.

[@nqtl-mc5800]

How yo 9:16 ratio with text to video ? Thanks

[@taoprompts]

I don't think there's a way to do that right now

[@nqtl-mc5800]

@@taoprompts thanks 😍

[@MrRandomPlays_1987]

4:43 - Note that the wings of the horse are actually not really truly connected to his body, they seem to appear in the background and behind the horse and not really belonging to him so that's why Luma showed them on the back of the horse and then it disappears because of that, try generating such video using a clearly visible wings that are visibly coming out of the horse's body and then it should work better I suppose.

[@taoprompts]

Thanks for the suggestion, I tried other images where the wings attachment is more clear and it does seem to work better

[@MrRandomPlays_1987]

@@taoprompts :) Cool, glad to hear

[@nadk666]

Very useful, thanks 👍🏽 i am yet to properly explore Luma, but i guess we dont need to mention the style of video (like pixar etc) required in the prompt ?

[@taoprompts]

If you're using image-to-video (with a reference image) then it should automatically copy your image style. If you're generating videos with just the prompt then you do need to mention the style you need (like pixar)

[@Incredibleanimationshindi]

How to make the character blink the eyes , I tried so many times some times it does but it's all automated, secondly how to over come deformation Help plz

[@taoprompts]

Turn off the "enhance prompt" feature, that will help the Ai follow your prompts better

[@Zinzinnovich]

the problem is you absolumtly not have any controls of what you are moving camera and subject and props....

[@taoprompts]

I am making a video on how to control camera motions better

[@alicekibbe]

Trying to use it but when the queue takes hours and you're limited to so few generations it's impossible to experiment and try to get good results

[@taoprompts]

Their website is overflowed right now, they'll probably add more servers as soon as they can.

[@Cleanpollutionfilmz]

Great video 💡

[@lunazamoraart]

so maybe i should go ahead and stick with runway ml for another 9 months. I am sure they will greatly improve by then

[@taoprompts]

The potential from Luma for is a lot higher than Runway imo. I think they just need to add in a few more features for it to be more consistent for us to use. But it is free to try which is always nice.

[@artemedutech]

great. have you seen they also released very short prompting guide. Would like to hear more about Prompting in every video

[@taoprompts]

Do you mean Luma officially released a prompting guide? Where can I find that?

[@lastchildz8567]

it's a good start. luma works much better with reference images. I hope they work hard!

[@taoprompts]

Image-to-video does work pretty well. I do also plan on doing some experiments with just the prompts.

[@onlyyoucanstopevil9024]

GG

[@AIrtist-xk2dl]

I think you underestimated the 100% prompt ❤❤❤

[@taoprompts]

I haven't experimented with only using the prompt by itself, there's definitely a lot of things I want to try out.

[@AIrtist-xk2dl]

@@taoprompts if you want to see examples on my channel, exclusively prompts except the first videos they are visible due to the quality which I find average in comparison with the 100% prompt

[@22cine]

It's not an art form. It's stealing bread from real artists. 👎

[@pgarza1218]

Haha seem recognized the movie slots haa😊

[@taoprompts]

Yeah, it sure did

[@HaggisWildlifeFoundation]

Great video ma man

[@taoprompts]

Appreciate it man 👍. Ai video keeps getting better.

[@tobypointer]

Nice work

[@taoprompts]

Thanks Toby! Looking forward to see your review of Luma

[@Sean43322]

Another wonderful tutorial, thanks 💯

[@taoprompts]

Thanks Sean, Luma has some really impressive capabilities.

[@WillyCash69]

This is what we needed. A service that puts real pressure on OpenAI

[@taoprompts]

Hopefully this pushes them to let us try Sora soon