How to Create A Short Film with AI | Midjourney & RunwayML Tutorial

[@MDMZ]

How to generate consistent characters: kzbin.info/www/bejne/mKayepSqlLeipM0

[@shadrackkiban4716]

Use the prompt below: "I'm working on this cool short film project. My plan is to use MidJourney to generate a bunch of images. Then, I'll run those images through another AI called Gen2 to bring them to life. After that, I'll piece all those animated scenes together to tell a really captivating story. Here's the story idea: A 30 year old man who's stuck out in the middle of the sea during a sea storm, they finally spot an island in the distance. Here’s where I need your help: 1. Provide 10 simple comma-separated keywords describing the main character; what they look like and what they're wearing 2. Develop the story further and break it down into different shots, for each shot, provide 10 simple comma-separated keywords in this this structure: - Camera angle and position - Action, environment, time of day, lighting. - Don't include: Camera movement, sound."

[@Davindersingh-bo6ek]

Why haven't this comment pinned?

[@thomasscott2426]

As someone who recently learned AI just 3 days ago, i can confirm that this is doable. Wrote my first script for a movie and AI helped me bring it somewhat to life. Its just a trailer but i plan i going all the way with it.

[@seouliteusexpat1424]

I would love to see the trailer.

[@chrismccathern4653]

which program did you use

[@thomasscott2426]

@@chrismccathern4653 I used about four different programs for what I was doing but mind you it does cost a subscription. It all depends on how serious you want to get into AI free stuff normally comes with limitations.

[@wmurray003]

Let us see it.

[@thomasscott2426]

@@wmurray003 my second version is being uploaded now.

[@MDMZ]

You can now create entire films using just a computer !!🎥💻 The first 500 people to use my link will get a 1 month free trial of Skillshare skl.sh/mdmz01241

[@Hammy5641]

And what's the maximum duration for these 'films'?

[@theycallmelucky]

here's where i need your help: 1. provide 10 simple comma - separated keywords describing of the main character; what they look like and what they are wearing 2. Break the story further and break it down into different shots for each shots provide 10 simple comma - separated keywords in this structure - camera angle and position -Action, environment , time of day, lighting -Dont include: camera movement sound PROMPT might help.

[@AMidnightsTale]

Your a champion for this dude!

[@Inspired_JG]

Solid feedback.

[@anawakoff]

Wow, I'm really impressed. I tried out some of the AI processes and tools you mentioned to make a short fantasy film. But I have to admit that your work is on a whole other level. Congratulations

[@MDMZ]

🙏

[@PHANTAZMA]

Now with Sora AI, it's about to get real crazy! Great Video! 🔥🔥🔥

[@MDMZ]

Can't wait to use it

[@zeeesea]

Is there more information about the release? Btw this was an awesome video@@MDMZ

[@MDMZ]

@@zeeesea it's probably gonna take a while before it's available to everyone, I can't wait

[@akinyiyvonne3512]

DONT YOU THINK ITS GOING TO TAKE OUR JOBS AS FILM MAKERS @@MDMZ

[@jrod4God777]

@@MDMZ how do you add voiceover and text to speech?

[@chaos_visuals]

it's absolutely game changing for creatives who want to try out putting their ideas to life💯

[@LabyrinthofLogic]

This is actually insane. I threw and image in Gen 2 and I about hit the floor. The future is now.

[@MDMZ]

you can use rotoscoping and composite in post

[@oleole4340]

Man, as soon as consistency in AI generation reached the whole cinema industry changes drastically

[@MDMZ]

I agree

[@S9universe]

maybe implode

[@AICLASSROhM]

underated comment. none of the AI developers are focussing on character consistency. even the same seed value doesnt do justice.

[@patrickt6642]

Has long has its not woke and a good story that's what matters.

[@veilofreality]

more than consistency I think the biggest problem is getting the AI systems to understand the borders between character and elements in the surrounding

[@imagineartsstudio]

Dude is a Super-Genius! Thanks!😂😂😂

[@TahaSumra]

How to get consistent character looks. That part you missed and that's the only thing I was looking for

[@MDMZ]

I have another video on that

[@TahaSumra]

@@MDMZ Link please. I searched but not able to find. Thank you.

[@theprophetminstrel1597]

I was just thinking about this technology last night.

[@Inspired_JG]

One additional recommendation with midjourney is to use the style reference (-sref url). I have a short on my channel showing the results for reference.

[@MDMZ]

great tip, I think it's better to use cref, since sref is more for style referencing

[@Toolgdskli]

The ultimate AI power: you’re able to automatically convert a novel into a movie.

[@gu9838]

not bad at all runway gen2 CLEARLY has limations but if you can work around it you can make some cool stuff! BIG TIP get unlimited if you can afford it at least for the first month or so. that way you can produce unlimited videos without credits (can wait till near the end to use the credits before they reset) and have all the time you want to learn how to use the tools and understand its limatiions and work around it helped for me!

[@MDMZ]

thanks for the tip, good things is that all these tools are getting better and better, sometimes I share my opinion and one month later, it's no longer relevant 😅

[@unfltrdpassion]

is there another video on consistent characters? seems to be the missing piece for really bring this all together

[@MDMZ]

try to be as specific as you can in the prompt, describe your character in details, it helps

[@jacksan-ck7xo]

Thank you❤

[@chamindagunasekara97]

Amazing🥰😍

[@lym-ro8ws]

Great video as always! I’ve been using Stylar for a while now, and I’d love to see how you think it stacks up against Midjourney.

[@MDMZ]

I haven't tried it myself to be honest

[@solipedia]

Thank you so much. valuable information

[@MDMZ]

Glad it was helpful!

[@AbdulLathief2090]

BRILLIANT 🎥

[@conhuir]

Runway ML is still king. Pika was a major let down! Great tutorial dude

[@PlayOfLifeOfficial]

They recently put a pay wall on pika, it blew my mind ahah

[@ShaqShalom]

Thanks. What is the best combination of tools as of today, to generate AI top videos?

[@MDMZ]

I'm working on a video about that

[@prernasharma5710]

Awesome!

[@TheBlessingReport]

Great job

[@smeech5177]

Also, I think utilizing Adobe After Affects could work tremendously if done right for movement but idk

[@sameeramin822]

Love your videos ❤

[@mauvaissinges5254]

I'm currently wrking on a short animated story for children. The difficult part is consistancy between shot, poses, the character are never the same. More easy with realistic style

[@MDMZ]

it's true, you might be able to get more consistency if you're prompts are more detailed and descriptive

[@amang39]

Hey Buddy! Thanks for making this video. It’s helpful. Can you please share the prompt which you used in ChatGPT to describe the characters etc ?

[@MDMZ]

hi there, it's linked in the description, available for free on my patreon

[@rafatenangel]

Where can I watch the final result?

[@MDMZ]

just added to description

[@AIHahb]

helpful video

[@MDMZ]

Glad you think so!

[@Mrc.182]

Adorei o vídeo. Vou começar a usar no meu canal. Sou do Brasil obrigado pelas dicas

[@pedromorais6565]

marcha

[@RacherW]

How it is possible you have such good quality of this videos? My videos after editing photos in Runway ML looks like 480p.

[@MDMZ]

not sure, I haven't done much beyond what's covered in the video, maybe you can try upscaling your video using Topaz video AI

[@RacherW]

@@MDMZ Thanks, i'll try 😁

[@cafe_dastan]

Hello, thank you for answering my question When we create a character with AI , how can we make the photos with the look we created in the first photo in the next photos. That is, don't make the character of the story with a new look in every photo

[@MDMZ]

Check the pinned comment 😉

[@08tothe19]

Is it possible that I put the real person's image into the CHATGPT or Midjourney, so I make some shots based on that person? I am currently working on a new short film, and I wanna make some footages in the film by AI imaging technology.

[@PopCultureCollage]

I think you can use Midjourny. Just upload the reference image to midjourney. Copy the image URl (right click image to do this after uploading it). Write your prompt, maybe describe your person, then write --cref and-paste-the-link-here Good luck. :)

[@MDMZ]

which AI voice ?

[@StoryInspirations]

One question: images and videos generated by free AI tools such as midjourney ....monintizable in KZbin?????? Pls reply

[@nonstopvibes3493]

legend boss

[@ondrej73]

still getting an error --------------------------------- !!! Exception during processing!!! Error(s) in loading state_dict for ImageProjModel: size mismatch for proj.weight: copying a param with shape torch.Size([8192, 1024]) from checkpoint, the shape in current model is torch.Size([8192, 1280]). ---------------------------------- any idea? thanx

[@rashadcolvin3518]

This is dope!!

[@degreatech]

I love you bro

[@imgnryvansh]

Sora will change the world forever.

[@MDMZ]

I agree

[@hussainrabeea6017]

this is fantastic tutorial. thanx all best please keep going

[@MDMZ]

glad you liked it

[@listentobaladu]

Looks decent but it is not even close to a film or even a film strip, and could have been produced in 1980. I hope there is some decent AI movie programs coming soon - this wait is way too long.

[@digital_magic]

Thanx for the great tutorial 🙂

[@MDMZ]

My pleasure 😊

[@vlada5358]

how to make sure that the same man appears in all pictures? It constantly generates different ones.

[@MDMZ]

I have a follow up tutorial on that coming soon

[@vlada5358]

@@MDMZ great 🧡🧡🧡🧡

[@philipdratcliffe9648]

I've tried runway and watched the pros do it too and honestly, it fucking sucks with certain things. With human movement especially facial and eyes it fails every time without fail. Sora and veo will leave this thing buried

[@Rohittarkar175]

Can i make it 15 min longer?

[@MDMZ]

you can animate as many scenes as you want therefore making your video longer

[@Loading...5911]

thanks bro love u 3000

[@MDMZ]

Enjoy

[@explorewithaera8110]

how can I always keep the same character? It always change my main character to a new character?

[@MDMZ]

check the pinned comment 😉

[@explorewithaera8110]

@@MDMZ Thank you for the reply!

[@khaledmohammed8890]

How to make charcters consistent when generating images

[@MDMZ]

you can describe the character in details in the prompt, it helps

[@rrikisolmain]

Short question: in paid subscription of any of ai tools! Do you have The Rights to sell them (image/photos) in stock Photography?

[@Gamervidsman2000]

No

[@alihamza-nh2ft]

CAN we generate motion vidoe by Using only Mid journey?

[@MDMZ]

Midjourney doesnt generate motion

[@jmbeats_prod]

Is there a video of yours that teaches you how to use your own video and use artificial intelligence and make another video with a moving background?! For example, I want to take a video of myself with my face and then play it on the A.I. and put a moving scene, where in my eyes it shows a city with buildings. When I open my mouth, smoke comes out and in the background there is nature full of animals flying and walking. I want to make a video like this for my album.

[@MDMZ]

that's to specific, might as well use traditional editing tools, lots of masking, rotoscoping, and you can use AI for certain parts, it's even more fun that way

[@micheleastolfi]

HELP: How is it possible to be able to recreate the same protagonist but in different shots and scenarios? Thanksss!!!!!!

[@MDMZ]

YES! I have a tutorial on that coming tomorrow

[@spinfoamcanvas2823]

how do access the prompt you use in the ur short film...

[@MDMZ]

everything is in the description

[@SafraCreatorhook]

I did a video a week back.. it was a guge disposable cup flying.. when the cup fly then textture of the cup changes. I asked many people all they said was something to do with motion ..but did not explain clearly.any solution?

[@MDMZ]

it's really hard to tell, there are many factors involved, try to experiment with different settings

[@SafraCreatorhook]

@@MDMZ thanks

[@spinfoamcanvas2823]

can u add dialog scenes in midjourney

[@doyouknow1022]

Can we generate same face for all scenes The main issue with AI is, it will generate different different images for different scenes

[@MDMZ]

I'm planning to make a video on this

[@doyouknow1022]

@@MDMZ please make

[@sajinscartoonvine]

I tagged you in my video in my channel that i create after watching your short film... You may not see....

[@MDMZ]

Great job!

[@sajinscartoonvine]

@@MDMZ Thank you

[@aDAMoscar]

You said you will link the comfy ui work flow! I cant find it in the description 😢

[@MDMZ]

pretty sure I haven't, because I didn't use comfyui in this video 😅

[@Mmmmk9797]

How much do I have to pay to use this effect?

[@dujohngilatar]

How to get consistent pictures

[@MDMZ]

make sure your prompts are as specific as possible

[@healthwealthgurus]

Hi how do you ensure a character generated in mid journey remains consistent in each generated image. Ie they look the same ?

[@MDMZ]

you can use a face swap tool after selecting your images, and having detailed prompts with consistent character description helps a lot too

[@Onlison]

The author is correct. It's a known technique. The better method is create a blank background of the general figure (person) you're using, and when prompting; your goal is to add in the background, leaving the figure (person), untouched. The more you edit images, which were created by computers, the image becomes inconsistent; as our forms of art don't always match a computer's idea of art. - Onlison

[@tallescarvalhofilmes5040]

I can´t acess the link of the prompt. Can you help me?

[@MDMZ]

what happens when you click on it ?

[@mayurpandya2237]

how we can create same face image in every shot?

[@varunsiriah1user557]

Biggest question in AI film making ever Consistency

[@MDMZ]

you can guide it as close as possible with prompts, I've shared some tips in the video

[@mandalmandal4593]

I just saw an AI generated video, that's 10 mins long, with the same characters, is it fake or real? It looked so good. I thought it was animated, i was like i need to see a 10 mins AI generated video so i came to look here, i couldn't find any AI generated video like it, i think its animated. So confused.😢

[@MDMZ]

it's possible that it's AI, what makes you doubt it ? is it the realism?

[@Niveditaaaaaaaa]

Please make a video on same topicbit for free ai generators like leinardo, genmo please

[@enricociacchi94]

Is it free video ai gneerator?

[@SustainabilityJobslist]

i like the way you talk.......

[@lunazamoraart]

This is wonderful but other than being super creative, how is it useful?

[@MDMZ]

creative IS useful, we'll see this and other similar methods implemented in commercials/movies really soon

[@thewestindianboy]

wow

[@zytnpltr]

Yeah, I've watched all these types of videos and It's still nearly impossible to get the consistency to really flow. Makes it nearly impossible to tell a story with a fluid character. Even when using the same descriptive prompts for each shot, adding the new scene, it's practically a new character each time lol. This will be killer in a few updates but for now.....sigh

[@MDMZ]

I guess you can try to use some face swap AI after generating

[@tmx680]

where´s the movie?

[@opianist4]

Can I use sounds the movies ?

[@MDMZ]

not sure if I understand your question

[@joelgarner667]

Do you take on commission projects?

[@MDMZ]

Check the related video for full workflow

[@yashgood4481]

where can we see the video u created?

[@MDMZ]

I uploaded it as a short

[@cheddartheater]

Great info and pace, but that AI voice is a nightmare.

[@smeech5177]

Am I able to use a seed for midjourney from NightCafe?

[@MDMZ]

you can try :)

[@Onlison]

No, you may not. This seeding process in Midjourney to NightCafe would be incompatible at this time. They don't offer interoperability for seed numbers. - Onlison

[@StoryMingles]

Is this possible to do on IPhone?

[@MDMZ]

hmmm, time to test some stuff 😁

[@Hammy5641]

How do you get away from that cheesy ‘Top Gun: Maverick’ look/aesthetic & get something, overall, more classy - like Hugh Hudson’s shots of Istanbul - at the start of ‘Midnight Express’; or, to use a contemporary example: ‘Baltimore/Rose’s War’ (Imogen Poots)

[@MDMZ]

you can try to specify that in the prompt

[@germanmairen]

No matter how people try to sell this. The end result is rubbish

[@777dot77]

Can you use your own photos and videos for A.I video editing? If so what sites and programs can you use?

[@lukewilliams7020]

This sadly is not a film just a series of basically still images

[@MDMZ]

These tools are only gonna get better and this is the core principle of it, just like how the first flight ever only lasted 12 seconds

[@sixgunguerrilla]

@@MDMZ The first flight was still a flight. These are drawings with a zoom effect.

[@sedisdead]

@@sixgunguerrillamay not be a full film but definitely can see how it would be useful when making a film. Maybe for a specific short scent or something like that

[@RichardsShortHorrorFilms]

@@sixgunguerrillaExactly! It’s maddening talking to AI enthusiasts.

[@sniperkota]

IA video

[@sanjayt4862]

System requirements??

[@MDMZ]

no specific system requirements for midjourney, Gen2 works on the cloud so it's irrelevant, your best bet is to give it a shot

[@andrewrozhen513]

Too bad the tutorial doesn’t cover the most important thing - how to make characters consistent.

[@MDMZ]

that's where prompting comes in, try to be as specific as you can with the description and use it in all your prompts

[@andrewrozhen513]

@@MDMZ thanks for the reply

[@mezoadel3211]

Like it

[@MDMZ]

I'm glad you like it

[@user-bc6oo4hq5p]

No free

[@xXTeamaXx]

Can I put my face in the video and how?

[@MDMZ]

use a face swapper

[@xXTeamaXx]

​@@MDMZ What software do I use?

[@NGW_Studio]

Personally i use pika to animate my short stories but runway so expensive

[@MDMZ]

Glad it works for you

[@JoshForet]

less attempts with runway makes it about the same

[@dishaa8691]

the midjourney discord version is also paid....????

[@MDMZ]

Midjourney is a paid service, totally worth it tho

[@dishaa8691]

@@MDMZ fine sir

[@stunnerbiltz]

😢😢😢😢😢😢

[@OvenGlobalDomination]

Thats basicly an animated comic overview or a really simple basic anime making tool lol

[@JohnDoe-wl7fu]

Where is fucking option to i can make video or illustrations all i can get is of bunch teching classes i not go in scholl again??

[@shawnsg]

_film_

[@Richie4uAI]

This is really bad. It’s super expensive and you throw away more credits on bad videos than on videos you can use. Such a disappointment. Don’t get it!

[@MDMZ]

hi there, can you elaborate on what makes this "really bad" ?

[@scolexuk]

I dont consider that you make a film this way -- you ask a computer to make a film for you. Ditch the Chat GPT and use your own creativity. Please.

[@MDMZ]

ditch your keyboard and use a pigeon to send me this feedback

[@scolexuk]

@@MDMZ Chat GPT, can you give me a "witty" riposte to a comment that touched a nerve?

[@scolexuk]

And lest I succumb to the temptation to make a sarcastic comment without addressing the substance of your response -- Your "keyboard/pigeon" analogy doesn't work, and this is why: You'll notice that I didn't recommend getting rid of every AI tool in your proposed workflow, only the use of Chat GPT to come up with a shooting script. The purpose of these technologies is to allow us to overcome material restraints. In the example of the pigeon, I use the computer because it would otherwise be nearly impossible to get a message to you. But the pigeon/keyboard doesn't write my message for me. Traditional filmmaking is expensive and requires resources both human and financial that are well beyond what is available to the vast majority of potential filmmakers. This is why it makes sense to use whatever other tools are available to get the film from page to screen. But from brain to page? There is no such restriction when it comes to writing a shooting script or conceiving a storyboard. Why should we use an LLM to do something that is available to anyone with a brain and a piece of paper? What restrictions are being overcome in that case? I never suggested the film would be bad, just that it wouldn't in any real sense be the product of your own creativity. I'm not being a technophobe when I choose to walk around a shop instead of using a mobility scooter. You would be rightly suspicious, even contemptuous, of an able-bodied person who chose to do so. And such a person would soon find him/herself unable to walk around without such assistance. In addition, such AIs are designed to give the most statistically likely response. By their very nature, they cannot be "creative" in the generally understood sense. Any scene that you allow an AI to write for you will only rehash what it has seen already, denying you the opportunity for any genuinely personal expression. The difference between Lars von Trier and Alfred Hitchcock lies precisely in the step that you are proposing be handed over, unnecessarily, to a computer. As with the person who allows a scooter to do their walking for them, any human ability that is not used will eventually wither and die. By all means, use AI tools to do what you cannot do on your own. But if you can't even conceive of how to tell a story visually without the use of an LLM, or are too lazy or scared to try, then you are not a filmmaker, you are a prompt engineer.

[@kanohane]

That man looks 45+, not 30....😭

[@MDMZ]

Too much time in the sea do that to you 🤣

[@jadenkarim5367]

Bye Bye Hollywood!

[@MDMZ]

unless Hollywood jumps on this

[@jadenkarim5367]

Sure, they'll adapt if they wanna survive, or else join WGA strike @@MDMZ

[@Onlison]

Hollywood box offices clear 9 Billion annually. They've dedicated hundreds of years to the art of film making. AI videos will never come remotely close to making something like Transformers or Avatar. Keep Creating Friend!