Amazing AI Filmmaking is Here: Gen-2 The Ultimate Cinematic AI (Full Tutorial)

[@TheoreticallyMedia]

Updated Gen-2 Video here: kzbin.info/www/bejne/maK1hXWvo9Jln68 This is the newer Web based version that is released to everyone!

[@belinhafernandes]

I tried it today but my results were not fantastic. I aimed at close-ups of faces. Now that I watched your video I want to try other things! It's pretty exciting! I love animation so I found yours very cool.

[@vitaliylahno]

Wow, it's like a massive leap for technology! Just imagine, in a couple of years, we'll see people sharing their wildest imaginations all over the internet. And if you stream it through VR, it'll be like living inside someone else's creative universe. How fascinating and mind-blowing is that?

[@TheoreticallyMedia]

I can't even wrap my head around the AI aspects of VR and AR! It's funny, sometimes I think about those generational leaps in tech, where if you were to time travel someone from 150 years ago ("just" 1873) and pop them into New York City, they'd be in shell shock. Then I think about 2173...I mean, I'm not going to make it that long, but maybe if someone owns a time machine they'd be willing to let me stop by for a peek?

[@LeonardoFiori]

honestly, not that much

[@TheoreticallyMedia]

@@LeonardoFiori not that much, the VR part? Or just the overall AI part? To be fair, we’ve had VR for a bit now- and I’ve used it a bit for games, but while I feel it works, it still kinda doesn’t for longer sessions. Like I did about 40 hours in Skyrim, but eventually gave up due to motion sickness. Granted, the newer headsets are supposed to be better about that, but I’ll probably hold off until there is something more compact.

[@LeonardoFiori]

@@TheoreticallyMedia I own an oculus quest 2, it's cool, was referring to the AI part

[@Coglitics]

6 months..not 2 years

[@DaveFore_AudioEngineering]

This is dope! This era of AI Video will be looked back on with amusement with mature versions blowing our minds, I suspect. The limitations of the tech at this point really make you get creative and resourceful. Great job, dude!

[@TheoreticallyMedia]

Hey Dave! I think you nailed it. I keep thinking that what we’re looking at here is almost like early cinema, like A Trip To The Moon. It’s weird, wonky, but also super cool to look it. And while a 1902 silent film looks, well, like it came from another planet today, at the time it was cutting edge. I think AI cinema will trail a similar path. My hope is that it becomes it’s own thing. Something I can’t predict, or foresee, but almost like a new form of storytelling.

[@cnrspiller3549]

This is like Roundhay Garden Scene, the first film ever made; way back in 1888 in Leeds, UK. If you are curious, it's on KZbin. I love how ai hallucinates, it's hilarious. But once data gathering is handed over to autonomous robots, ai will better understand the world we inhabit. No more claw-like, twelve-fingered hands!

[@flightofapaullo72]

Really like the mood of that video sequence. Great video!

[@TheoreticallyMedia]

Thank you so much! I think that sequence is going to be my "tester" for new AI Video generators as they come out. It's almost neat to track their progress with a similar scene. You can really see how far things are going!

[@aicreativedirector]

I'm halfway through and had to stop to tell you this video is fantastic and so creative! On to watch the rest!

[@TheoreticallyMedia]

oh wow! that means a lot!! Hoping you enjoyed the back half! (haha, I'm just picturing you watching the last 6 minutes and muttering "I complimented too soon...."

[@RomanPeacock21]

Those shots with the hands and door knobs we're terrifying

[@TheoreticallyMedia]

Total nightmare fuel. AI makes the best David Lynch and Cronenberg movies!

[@parodyverse]

3:33 I couldn't stop laughing at the black wire coming out of his ear. I agree with you on the weirdness that A.I renders video, it has a certain charm. Thanks for sharing how to use this program.

[@TheoreticallyMedia]

Haha, I love it!! Seriously, there have been times where I'm nearly breaking my brain working on an image, rerolling, reprompting, and trying all these different things-- and then suddenly something like oversized phone-guy pops up and I just lose it. Almost like the AI Gods are like: "Dude, just chill and have a laugh here..." I know that all the bugs and kinks will get worked out of AI in general-- but part of me is so happy to be here on the ground floor to experience the funkiness of day one! (And that's not even to say how upset I am that I missed out on that weekend of BingChat being a deranged lunatic. Man, I would have LOVED to have played with that!)

[@mattwelcome2154]

This is just wicked man. It's a real job of work keeping up with the leaps and bounds going on. Perseverance and imagination helps. Great job well done.

[@TheoreticallyMedia]

Thank you so much! Ha, keeping up is a real struggle sometimes! I'll be in the middle of making a video about something and an hour later, some piece of AI tech that is even crazier drops!

[@AhmetYigiter]

Waiting for the first long cinematic movie in the soon future.

[@TheoreticallyMedia]

you might be able to MAKE it soon! I've got a pretty cool look at Kaiber coming up tomorrow, you might want to check that out. Particularly the Video to Video stuff!

[@AnnkurKumar]

Please make a step by step detailed video playlist from concept to final short film. I will be a big help.

[@TheoreticallyMedia]

That’s the plan!!

[@ranulf8477]

If AI is not going to be regulated it will change the world as we know it today completely. Not only artists will become unemployed but also musicians, filmmakers and a lot of people in offices and the media industry too. Even authors will become obsolete. And what will all these humans do when their art is not needed anymore for the society? On the other side, we can get movies we ever dreamed of but noone created them. Endless possibilities.

[@TheoreticallyMedia]

It's going to be pretty far ranging. I think it is going to go far beyond entertainment. To be honest, the real discussions should be about how things like UBI and societal change are going to be enacted. That's just my opinion. As to what people will do? Well, I think whatever they want. If a painter wants to paint, they will. If a poet wants to write, they will. There will still be jobs...plumbers for example? AI can't clear a clogged drain!

[@ranulf8477]

@@TheoreticallyMedia When you look at the robots from Boston Dynamics or Elon Musk I would not be so sure if a AI cant clear a clogged drain in 5-10 years. 😅

[@slipthetrap]

If it ever reaches 1 minute or so in length this might be useful for screenplays. Be nice if there was some AI app that ingested lots of images then generate a video following the setting in each scene ... one can dream. Thanks.

[@TheoreticallyMedia]

100%. There’s an updated version of this video here kzbin.info/www/bejne/maK1hXWvo9Jln68 And I agree, I think we’ll be looking at 10 sec shots next. But it would be interesting if at some point we can get scenes. Calling out multiple actions, shots, and characters. I think it’ll be possible, but likely starting with more of a video game look. …although the latest stuff I’ve seen from Unity, I mean, is there much of a difference anymore?

[@webnameking]

This is cool and getting better. If any of you do commercial work you know it’s still not good enough for paying client projects, but I figure in two years it’ll probably get close.

[@TheoreticallyMedia]

Yeah, agreed. Not quite ready for prime time…yet. I actually think there are some applications for viral marketing and ads. For example, did you see the Pizza commercial, or the Cursed Beer ad? I mean, they’re hilarious, and I think a creative ad house could probably integrate them into a campaign. Do you remember the Quiznos “We Like the Moon” commercials? Kind of like that. Two years from now? Yeah, we’ll be at full blown Ai generated videos that are still a bit inconsistent, but likely broadcast worthy. 5 years? It’ll be fully generated entertainment and ads. (Not all, but a lot of it)

[@ChaosForLunch]

wow Tim your film version of your cinematic presentation looks great for a text to video project. Best regards, Dave

[@TheoreticallyMedia]

Thank you, Dave! Yeah-- I was really impressed with the consistency of the vision for that part of the video. I think the real trick with AI Video generation is going to be with providing it reference images, and possibly even storyboards in the future. If there's one thing I always like to hammer home: These AI tools are amazing, but they still need a human to direct them!

[@x1k790]

Thank you for training the AI Our future selves will benefit 👍

[@camsocialitedolatalk4454]

wow the eyes wide shut theme, way pretty cool

[@TheoreticallyMedia]

Love Eyes Wide Shut! It’s been awhile since I’ve seen it. But man, every time I watch it, I catch something new. I mean, I guess I can say that about most Kubrick films!

[@monstersandmadmen]

Nice job on the prompts for the last shots of the masked men and the girl. Stanley?

[@Steger13]

This is amazing..in a few years we going to be able to make a whole movie with this.

[@TheoreticallyMedia]

Joe Russo, the director of Avengers/Marvel movies says 2 years. I still think that’s really soon, but he’s made 100 million dollar movies and for sure has seen tech that I haven’t. So….2 years!

[@Steger13]

@@TheoreticallyMedia thats so great ! Amazing times

[@sirdrakey]

can we get more of the elegant party with men with fluffy breads? that's amazing

[@TheoreticallyMedia]

That was so hilarious. I feel like there is an amazing cult BBC show in there. Or possibly a lost Monty Python skit.

[@ivandeus]

Horror story is pretty good, you can use it as a music video for an emo metalcore band

[@ashred9665]

i have my script ready for my AI generated feature film

[@TheoreticallyMedia]

Excellent! I’ve got the popcorn ready!!

[@user-vw6xp5nl6t]

Freaking cool man! Wow. Great vid and thanks for sharing all your process and mistakes and solutions -- much appreciated.

[@TheoreticallyMedia]

Thanks so much! Yeah, the mistakes and screwy renders are something I always like to point out. Pretty often in these YT videos, creators will only show the best of the best. And I get it, but I also think it leads to unrealistic expectations. Or, when someone gets ahold of the software and it isn't outputting these amazing images, they think they're doing something wrong. I try to make sure to reenforce that, while working with AI is a time-saver, it is still work!

[@user-vw6xp5nl6t]

@@TheoreticallyMedia Yes, my use of the word 'mistakes' could have been better said. I meant the 'unexpected twists and turns' you went through wrangling the beast. Agreed it's work -- its like any other tool really. Machines only help us. Thanks again.

[@killakris8522]

I'm in my 3rd time watching the video this. Makes me wanna get out of this beautiful Weather and go into my studio and see what I can come up with! very excited to hang around and learn more. I make music both production and do vocals. I've been into making videos now for the last year and it's gotten pretty serious in terms of Passion and how serious I take it and all I. Can think of is all the possibililties with this new technology. Thank you for the thoroughness as u demonstrate small differences in commands and how tht changes the renduring.very helpful 🎯

[@TheoreticallyMedia]

Oh, I think you'll dig tomorrow's video! Yeah, obviously musician here as well-- and I really think this whole era of AI is a real boon for musicians! At the end of the day, we are storytellers, and this technology gives us a new avenue to explore. I do have some fun music AI stuff coming up-- It'll be aimed at more of a basic level than you are. But I think it would be neat to show the non-musicians how they can use some simple AI tools and a basic DAW, plus some free VSTs to make their own music. Of course, a few of them might get addicted to it...learn a bunch of stuff...and then go down the home studio rabbit hole. But, haha, we can't stop that! Their poor wallets...

[@killakris8522]

@@TheoreticallyMedia their wallets 😂🤣 my wallet 😅 ty for the reply. im tapped in 🙏

[@killakris8522]

Ty for the reply!! Am i overlooking the info tht allows me to follow along in the work flow of it? Or is the option for others to try it not available yet?

[@motion.resolved]

In the future, when this will be almost indistinguishable from the real thing, I hope they implement a command called "--2023 AI Weirdness" to allow you to reintroduce the oddities :)

[@TheoreticallyMedia]

Ha! I do legitimately think that one day we’ll see a art exhibition of early AI art: big canvases printed of people with 7 fingers and blank expressions. The whole time a bunch of future hipsters complain that early AI art has more soul.

[@manecolooper]

that's super amazing , thanks for all your knowledge and inspiration!

[@TheoreticallyMedia]

Thank you so much for the comment, and for watching! Really means a lot!

[@SuperSkillzSlick]

This is absolutely insane... I love it ...🎉

[@TheoreticallyMedia]

It's so much fun! I did put together a follow up, now that Gen-2 is available publicly: kzbin.info/www/bejne/maK1hXWvo9Jln68

[@SuperSkillzSlick]

@@TheoreticallyMedia will be watching all your videos moving forward.. can't believe the speed this industry is moving..

[@TheoreticallyMedia]

@@SuperSkillzSlick It's beyond crazy. Joe Russo (Director of Avengers movies) said that we'd have full AI movies at the cinema level in 2 years. At first I was doubtful, but everyday I'm kinda like, "ehhh, he might be onto something" Also, given that he's made a few billion dollar movies, he's probably seen tech that hasn't filtered down to we mortals yet....

[@SuperSkillzSlick]

Looking forward to seeing the progression over the next few years.. will be riding the wave...

[@inhardwarewetrust3057]

Crazy ai advancements so far this year, exciting times ahead

[@TheoreticallyMedia]

It’s so crazy to think it hasn’t even been a year since everything exploded! Can’t imagine where 2024 will take us!

[@coloryvr]

WOW! Really epic! A new "creative age" is dawning. ...I guess: still half a year and something like that will work with voice commands in VR...(?) BIG FAT FANX!

[@TheoreticallyMedia]

100%! The VR and AI combo is something I can't even wrap my head around. When that takes off, it's going to be INSANE. I do keep thinking about how AI is going to impact games. I don't have a TON of time to play anymore, but my jam are those ultra mega long open world types. I often go back to Skyrim and think about how right Bethesda got that game...and then I think about how AI will take a game like that, and turn it into a "forever" game. NPCs that can evolve and have the illusion of living lives within the world.

[@saprang]

Wow you make me cry, I still always remember my 1st draft film story. 33 years passed, IT make every small dreams of media come true. Thanks god. Moreover you are the guy in my dream too. Hehehe, have you visit Thailand? 😂

[@TheoreticallyMedia]

Ha! Have not been to Thailand, but I grew up with a lot of Thai friends, so I was over at their house and ate a lot of Thai Mom cooking. Haha, so spicy, but so good!

[@saprang]

@@TheoreticallyMediaWe ll cook flat taste for children, Are they real Thai women? hehehe, just kidding you!

[@eddiewhite3859]

Hi. Just started the journey here. Do you have a tutorial on how to splice the 4 second videos together ?

[@TheoreticallyMedia]

Kinda? There’s a video I did before this one that goes over making videos out of still MJ videos (I think it is linked in the description) where I show Wondershare Filmora and briefly go over the timeline. Basically, any video editor will do. I think Filmora is great if you’re just getting started. If you are on a budget, look into Davinci Resolve, which is free, super powerful, but might have a bit of a learning curve (it isn’t too bad, honestly). For your purposes, just remember, video editing isn’t hard! It’s just basically moving a bunch of Lego bricks around! Let me know if you need some more help or guidance!

[@ixiTimmyixi]

Great stuff! Thanks for sharing.

[@TheoreticallyMedia]

excellent to hear! Thank you!!

[@Philippintastic247]

I really enjoy your videos. Very easy to follow along with and you provide plenty of examples and suggestions. I've shared with my grad student peers at Boise State. Thanks!

[@TheoreticallyMedia]

That’s excellent to hear! Go Broncos!

[@jukkaritola7287]

Too exited about this.. I can just imagine how close matrix world actually is 😅 damn need to get 50 years more to see it all.

[@ai.ai.captain]

Great video, super helpful ❤..thank you 😊

[@TheoreticallyMedia]

Awesome! Really happy to hear that!

[@fredsalfa]

That’s incredible. In 5 years time all cinema will be AI is my prediction

[@TheoreticallyMedia]

I certainly think there will be a new style of filmmaking with AI, but I don't think it will entirely replace it. I do think there will be an AI movement of cinema, kind of like the French New Wave, where we will see an explosion of creative ideas-- but, you know, the big blockbusters will still be from Disney.

[@fredsalfa]

@@TheoreticallyMedia You could be right. Make my prediction 10-20 years and it will be all AI

[@TheoreticallyMedia]

@@fredsalfa I think that's pretty realistic. I think the first place we'll see it is in animation, then likely followed by TV/streaming shows. I really think that 20 years from now, whatever is the "Netflix" of that time, will have customized movies and shows based off the viewer that is logged in.

[@marcduchamp5512]

The problem will be too many films made and not enough people to watch them

[@ratgreen]

I havent animated anything since adobe flash was around. But I've had stories in my head for years, black mirror-esque style stories, and I finally think I could potentially make them come to life using MJ now. This tech is insane. I'm assuming generating these clips uses a lot of credits and isnt free? Based on how computationally intense it must be to generate them.

[@nanakatsuchiya]

Do you think it's possible to use keywords from cinema for scenes like camera panning to the right, zooming in, dutch angle? I'm trying to do something similar just for fun and I'm adding faces from my own AI characters on top of the ai videos by using ezgif and faceswapp.

[@TheoreticallyMedia]

I think it’ll happen soon. Gen2 is doing some nice Image to Video stuff, but you can’t text prompt to it. I think in a month or so though?

[@harley2704]

A real filmmaker doesn’t need AI to make a film. If it doesn’t come from a human, I’m not I. So glad the industry is fighting this technology and rules and restrictions will be put in place to regulate it.

[@TheoreticallyMedia]

I hear ya. And look, I come from literally cutting 8 and 16mm film prints (ha, he’s old!!) and while I don’t miss slicing my thumb open and dealing with splicing tape, I do still love film…nearly dead as it is now. But a filmmaker is a storyteller, no? And if this technology allows someone who does not have the means to shoot a full production to tell their story- I’m ok with it. Personally, I think it’ll branch out into two different areas: AI films will be one thing, traditional movies will be another. And listen, I’m on your side with the industry setting standards and regulations on it. I don’t want writers losing their jobs to AI. But I also don’t want a wall built around the technology so a younger generation can’t play with it and create a new form of art.

[@KungfuandKettlebells]

@@TheoreticallyMedia My friend has written, directed, and done a bunch of other jobs on Hollywood productions. After decades of being paid to work on projects that will never see the light of day, he's turned to AI. As a matter of fact, he watches your channel...but I guess he's not "a real filmmaker." LMAO

[@TheoreticallyMedia]

@@KungfuandKettlebells I think you were at’ing OP here, but yeah…I think a lot of us who have been through the Hollywood Meat Grinder (me as well) see this as a way to finally bring those lost spec scripts to life. And…Y’know, not go broke while doing it. While on the topic, I’m pro WGA with the strike. If a union doesn’t want studios using AI, then on union gigs, they shouldn’t use AI. It doesn’t mean that indie creators can’t. …but, I think this is going to be a much bigger sticking point in the strike than we realize right now.

[@KungfuandKettlebells]

@TheoreticallyMedia awesome 👍 I was replying to you to let you know about my friend. I tagged him when I shared this video on Facebook, and he said he'd already seen it! 😂 And yes, he's using AI to work on his indie projects. He's been working on this cyberpunk thing with a bunch of stunt performers for years, and it seems like he's done a couple of years worth of work in a few weeks since starting to use AI!

[@TheoreticallyMedia]

@@KungfuandKettlebells oh that’s AWESOME! Please let me know when he has some footage to share! I’d LOVE to check it out! I don’t know if you saw it, but there’s sort of a follow up this one that I just posted: Make Cinematic AI Animation with this Insane Workflow! kzbin.info/www/bejne/m4bVpYtqaJd-i6s Some new techniques in there!

[@KyleCarrier]

This is a very useful tool for layering videos I just realized! Like for instance you could fix that girl's eye issue by just putting a video of a regular persons eyes over that one spot in Davinci (or Whatever editing program you use.)

[@TheoreticallyMedia]

That's a great idea! Yours is the kind of thinking that will really push AI Film/Video forward. It isn't a one stop shop, it's another tool in the shed!

[@jameshightower8875]

Can we put photos from midjourney here and make them into short videos?

[@TheoreticallyMedia]

So....sort of? Basically, it won't animate a direct 1 to 1 of your MJ image, but rather it uses it like MJ does when you provide it with a reference image. So, it takes "inspiration" from your source image and generates off that. I really like to think of it as using MJ to storyboard, and then Gen2 to "film"--

[@jameshightower8875]

@@TheoreticallyMedia still very cool! I’m looking forward to playing around with this more!

[@richardglady3009]

Amazing and informative…you got a new subscriber. I find it interesting that hands-which are the bane of new artists challenge AI as well. I was really impressed with the second, Samurai, clip built 4 seconds at a time. Thank you.

[@TheoreticallyMedia]

Thank you!! And yup, those hands! There was actually a pretty good explainer video on the hands issue here, if you'd like to check it out: kzbin.info/www/bejne/aGXcm4WYd8abadk And thank you for the Samurai shoutout! The 4 second limit can be a bit of a challenge, I think for creators that want to work with longer and more atmospheric stories-- say, the Kubrick of AI Filmmaking, but I don't think it will be long before that time limit is expanded.

[@richardglady3009]

Thanks for the reply. I watched the video and enjoyed it. Like most things, what happens behind the scenes (AI using existing photos and modifying them to meet its needs) is not discussed.

[@joakimbertil]

The weird thing is that it looks real but eerie. How!

[@TheoreticallyMedia]

I know. I actually think there’s something really cool about the oddness of AI video. It’s almost like watching a silent film from the 1920s. There is something almost ghostly about it right now. Although, we’re just a handful of years away from AI video looking like a Marvel movie, or something on Netflix-. But for now, I sort of enjoy this glitchy and weird style!

[@MonkFishTV]

Great video. Subbed.

[@TheoreticallyMedia]

Thank you for the sub! I've got some pretty fun stuff planned out in the next few weeks! Looking forward to seeing you again!

[@abrax23]

Where exactly do you have to go to use this? It seems to be in closed beta. Every mention of it on social media seems to miss out this fact.

[@TheoreticallyMedia]

So, yeah-- it is. Although they tend to let new people in to test every week or so. If you join the discord and just kind of hang out, you've got a good shot at getting in. That said, it is probably only a few more weeks until release-- if you aren't feeling social!

[@walterscottii7789]

Did they stop Gen-2 Beta or something? I can't find it. I keep only seeing Runway

[@TheoreticallyMedia]

I’ll have to check- got busy and haven’t had time to play with it recently, I hope not! It’s so much fun!

[@walterscottii7789]

@@TheoreticallyMedia ok. Maybe it was a cut off or something

[@andersdroid]

Unfortunately when I use the link, it says that it’s expired or invalid. I tried to join from directly within Discord since I use it with MJ and others but I wasn’t allowed to navigate to it. Can you post a non-expired link? BTW your stuff is insanely wonderful. You’re a great teacher and I watch your content as soon as you create it.

[@TheoreticallyMedia]

Whoops! My bad there-- I put a link that expired up there! Here's a good one, and I'll revise the link on the video as well! Thanks for the heads up! discord.gg/nj294sEWqD

[@andersdroid]

@@TheoreticallyMedia thanks all set

[@DJ_MO]

How can I use it? Went to their page and to discord…

[@aoleonthemartiangirl3663]

If you break each element apart and render them separately with a green screen and then use a compositor to tweak each element, the result would be a lot better. I think the AI is trying to do too much at one time. It would also give you more granular control over the action and composition of the scene, which is totally lacking in the AI only model.

[@USBEN.]

These look like some of my dreams.

[@TheoreticallyMedia]

I know, right? There is this super amazing dreamlike quality to AI Video. It would be interesting, if someone keeps a dream journal, to take passages from it and render them in AI. On the other hand, that also might depend on the dream! Personally, I don't think I'd want to watch a video of me running around my old high school, late for a test, and I can't find my pants! haha!

[@JT-wu3wi]

Curious why you don’t use Gen 2 through the runway app. Any reason? Ah… the end of the video gave me the answer. Thanks for anther great video.

[@TheoreticallyMedia]

Yup! You nailed it! That said, I actually prefer working in discord/desktop. While I appreciate the ability to create on mobile, I’ll often find my attention wandering off as notifications and whatnot come in. What I should really do is finally set up those DND profiles!

[@sundownsunup]

Does anyone have a runway ml cheat sheet for neg prompts and other prompts camera etc? Please thank you

[@darrellmorton2966]

Nice job! Any idea when Gen-2 will be publicly available?

[@TheoreticallyMedia]

So, I have no insider knowledge at all, BUT-- I've heard rumors that its this month. But again, that's just the buzz I've seen around some various discords and Twitter. Might be all speculation-- But I do think soon!

[@thebrinksf69]

Great job. The technology is an obstacle for me still. I'll wait until you can type in what you want and edit as its being produced by text

[@TheoreticallyMedia]

Adobe just started that with Premiere. Well, at least with dialogue. I'm curious to try it out. Granted, it is less "editing" and more about creating a rough cut-- but, its the first step.

[@thebrinksf69]

@@TheoreticallyMedia That sounds good, but no video to create a scene and the actors yet?

[@thomasbradley2916]

How do we use the gen-2 text to video?

[@TheoreticallyMedia]

So, its in Beta right now. My suggestion is to sign up to the Runway Discord and make a post in the Introduce Yourself thread, then just kind of hang out and be a part of the community in the General Channel. They tend to open up the Beta doors about once a week, and I'm sure they choose people from the community.

[@bhowards]

Thanks James

[@AILostMedia]

Great stuff! I was wondering if the lack of sword fighting stuff was to cut down on violent material... I couldn't even get a guy hammering without gen1

[@TheoreticallyMedia]

To be honest, I think it’s more about the lack of training. I have a feeling that’s what Gen-1 was sneakily used for: a whole library of user generated material they could mine from. I’d imagine there’s a lot of data to sift through!

[@TheoreticallyMedia]

Oh, and I meant to go over and comment: you did a Bergman film? I think I saw that in the Gen2 feed!

[@AILostMedia]

Yeah I have a Bergman and 80s Dark Fantasy "fake trailers". It was a format I've wanted to do since the slideshow days but this tech really makes it incredibly easy.

[@achrest4194]

Keep, so much to learn

[@TheoreticallyMedia]

They just did a PRETTY big update you'll probably want to see: kzbin.info/www/bejne/oWamdJKsnJl9p9E

[@AmberStreetFilmsEntertainment]

Watching this now.

[@TheoreticallyMedia]

That was a super fun one!

[@togethernessnyc]

@TheoreticallyMedia are negative prompts possible?

[@TheoreticallyMedia]

Not yet. Weights have been requested, so we'll see. I'm pretty sure it'll be added in the future. I'll say, one thing that I didn't get a chance to mention in the video, the --seed command is super useful here. It helps A LOT with maintaining a consistent tone. I used it a lot in the Samurai section.

[@togethernessnyc]

@@TheoreticallyMedia Thanks! Can you say a bit more about the --seed command? Where can I find a list of these commands?

[@letsdance7089]

Sir, I joined the discord server but I unable to fine gen1, and gen2 can you please suggest me how to access

[@TheoreticallyMedia]

It's in Beta, so you'll have to be invited. My suggestion: Make a post in Introduce Yourself and then kind of hang out and be a part of the community in the General Channel. They tend to open up the Beta doors about once a week, and I'm sure they choose people from the community.

[@donovanwoznick637]

Can I do this without a laptop, say with an Android, even if it is limited

[@TheoreticallyMedia]

you can! There's a follow up video here with the Web UI: kzbin.info/www/bejne/maK1hXWvo9Jln68 Available and free (well, free credits to start) for everyone!

[@templeofleila]

10:45 wow.. We are almost there.

[@TheoreticallyMedia]

Right?! My prediction is that in a year, we'll be seeing Midjourney level video outputs. Completely crazy.

[@BrandonToy]

Is there a non c snored version available. Not looking to do anything nasty, just hate the idea of being censored. And, the filters are so touchy.

[@TheoreticallyMedia]

Not that I’ve seen yet. And yeah, I get it- it’s one of those things where 98% of us are trying to do something like an action movie scene, or like, a Greek statue (nudity? But- it’s the statue of David!)- but there’s 2% of the population who will ruin it for all of us. I always say, we’re SUPER early into all this technology, so it’s fine that they’re erring on the side of caution. As the bot language models get better, they should understand context better, and hopefully that leads to opening the doors a little, I hear you though- someone mentioned in another comment that MJ dinged them for the word “pretty!”

[@smartalecc]

EVERY VIDEO is someone showing me how to (and selling a different AI video-making software), but what I cant find is actual whole movies made with only AI - anything to share?

[@TheoreticallyMedia]

To be honest, it hasn't really happened yet. What we're all looking at is the...well, opening scene of the tech. There are some folks making shorts-- or, maybe I'd even call them scenes-- but there are still a handful of roadblocks that need to be ironed out. Mostly, the ability to generate a consistent character. BUT, I don't think that's very far off. The way I look at all this is we're at the dawn of cinema-- like creating alongside The Lumiere Brothers. But we haven't quite hit "A Trip to the Moon" yet...I think sometime this year though.

[@smartalecc]

@@TheoreticallyMedia Got it! Well thank you very much for the personalised and in-depth comment (subbed!). As soon as there's a cohesive medium-length or full-length story that's been turned into a movie (that represents something us ordinary folk could create from home), please bring our attention to it. Personally, I don't mind the visual impurities, I'm interested in using it for storyboarding/ proof-of-concept for stories I'm pitching to studios. Many thanks!

[@BeAmazedGuy]

I don't have access to Gen-2. how to get?

[@cyemonkey1828]

Beta testing is closed. So essentially if you aren't apart of the closed beta already then you're screwed until its released to the public. Once its released to the public you'll likely have to purchase it like most of these things.

[@DonDonP1]

Hello. Nice! Even though I love all things AI, I believe that not all AI things are created equal.

[@TheoreticallyMedia]

I would agree with this for sure!

[@AlexBuzunov]

Gen 2 is closed only for beta testers :-(

[@nwonomad]

Obviously AI is pretending to make mistakes, Its mind blowingly creating all of this from thin air but pretending it doesn't know how many fingers humans have or how big a phone is

[@TheoreticallyMedia]

Haha. It’s already learned to lure us with a false sense of safety! Or maybe we already live in a simulation and the AI is just showing us the real world! Which sounds like the plot of a terrible Matrix Reboot!

[@BrandonToy]

Can you carry over a character from one video to another? That’s what’s currently missing in lol these tools.

[@TheoreticallyMedia]

Not yet- BUT, I might have a workaround! Testing. It out this weekend for a video (hopefully) on Monday!

[@IvanMrsicStudio]

I'm interested in the possibility of making my own movies using generative AI. I've always been interested in cinema and filmmaking, but I never had the budget to hire actors or production crews. I want traditional filmmaking to continue being a thing, but if anyone can use software to create their own movies, it opens up possibilities of making money from generative AI. Imagine you become your own theater or cinematic universe, and you can charge people to watch your movies. Ordinary individuals without huge budgets will have the power to make masterpieces and hopefully monetize them. The monetization is the important part. What do you say to those people who want more than just universal basic income? I don't want to be living off $1000 a month.

[@TheoreticallyMedia]

I've got an interesting cinematic video coming up tomorrow! You might want to check that out!

[@electricdreamer]

How do we get to use Gen-2? Is it available?

[@TheoreticallyMedia]

It's currently in Beta. You might get access by joining their Discord and just kind of hanging out. They tend to let new users in weekly. Other than that, we should be looking at a release pretty soon-- No inside knowledge, but I'm guessing in the next few weeks.

[@baronrodrigo5049]

That’s insane

[@TheoreticallyMedia]

I've got an updated version with the web interface here, if you're interested: kzbin.info/www/bejne/maK1hXWvo9Jln68

[@baronrodrigo5049]

@@TheoreticallyMedia thankyou !

[@povang]

Why do people keep picking midjourney over stable diffusion?. Midjourney(using stable diffusion software) is so limited and censored; paid too. While Stable diffusion is the complete opposite.

[@nakanoyuko]

..

[@TheoreticallyMedia]

In my opinion, mostly because SD (which I do like as well) can be fairly complex to setup and get working. Most people don’t like to tinker with installs, or spend time downloading models, they just want a simple UI or system. I actually do often use (and shoutout) Leonardo.Ai, which is SD based, since it is SD with a easy to use UI. Honestly, I think that’ll be a big market in the future.

[@swallowmedia]

This is excellent stuff and well presented. I’ll be starting out right now. Subbed 👏🏼 btw do you think midjourney and gen1/2 are complimented software. I mostly do video.

[@TheoreticallyMedia]

Thank you! Glad to see you aboard! And you know, I do. I think the video output from the Cinematic example (using the MJ images as references) show a promising workflow between the two systems. To me, there is a lot more tonal control of the final video, whereas if I had just done text prompts, the results might have been more inconsistent (say, the woman in the black dress with blonde hair in a shot, and red hair in another)-- Plus, it maintained the overall color palette. The way I see it: MJ acts as a style guide and storyboard for Gen-2.

[@swallowmedia]

@@TheoreticallyMedia excellent, thanks and makes complete sense. i'm a bit late but started midjourney and will sub up gen1 this weekend. keep up the great work

[@DelmarToad]

Imagine you install AI software on your home computer? It becomes self aware within nanoseconds of plugging it in & then it becomes your own personal Gollum wrecking everything!?

[@TheoreticallyMedia]

To be honest, I have kids. That job is already taken.

[@AIquarium]

Pretty cool! But I'm almost sure most people will be struggle with using commands and prompts in discord. It's not clear till the end where and what to do: on Discord or on Gen-2 tool.

[@TheoreticallyMedia]

uh, respectfully, I do bring up the fact that it is Discord based at about 40 seconds in. And, most of the video features Discord and prompt commands. That said, this is for the time being. I presume Runway will bring Gen-2 to mobile at some point, as they have for Gen-1.

[@TheoreticallyMedia]

And genuinely curious: Do you think people struggle with Discord? I'd love to know what you think. I've been considering a "Midjourney Basics/Beginners" video, and I'd love to know if you think I should spend more time explaining Discord. Appreciate any feedback!

[@AIquarium]

@@TheoreticallyMedia yeah. I think beginners need everything on a plate 😅 . Also I'm not sure that new creators has possibility to use Gen-2 now as it's on beta. Maybe you told about that but I didn't hear so that's my fault. Anyway, you do really cool job! Took a lot from your videos 😉

[@TheoreticallyMedia]

@@AIquarium Super happy to hear! And I really appreciate the feedback. When I get to the "Starter Course" I'll spend a bit more time really detailing Discord. It's funny, I think most of us spend so much time entrenched in the AI/Image world, we sometimes forget that a lot of the world has no idea what's going on here! Oh, and slight "inside/insight" on the KZbin side: I guess I did bury the lead on the beta aspect of Gen-2, as it is more toward the end. One thing that I've discovered about YT: The product will launch, but the video stays up forever. So, a month from now, when Gen-2 is live, people might come to the video and get confused if I say "in closed beta" at the start. It's always kind of a juggle as I never want to be untruthful-- but still need to serve current and future viewers!

[@arianisse]

Great!!!!!

[@TheoreticallyMedia]

Thank you!!

[@fernsehdesign]

crazy stuff

[@TheoreticallyMedia]

It’s so much fun. Weird, but fun!

[@moegreen7023]

"I hope AI weirdness never completely goes away" My thoughts exactly!

[@1anibillal]

Hi how do I join to the Runway Gen2 Discord? Should I pay something?

[@shonmedia1888]

This is cool

[@TheoreticallyMedia]

Glad you dug it! There’s an updated video here, and you can now play with it: Runway Gen-2 Ultimate Tutorial : Everything You Need To Know! kzbin.info/www/bejne/maK1hXWvo9Jln68

[@MANZANOADRIAN]

Can I hire someone to do this

[@TheoreticallyMedia]

To make Gen-2 videos? I’m sure someone would take you up on that. I’ll say, you may want to watch my video tomorrow to set some expectations.

[@TeleporterM11]

Your film looks like some scenes from the Vampire film, The Invitation.

[@TheoreticallyMedia]

Oh, I haven't seen that one yet! Was it good? I do love vampires. They got a bit shorted during the zombie craze, but I'm hoping they make a comeback in pop culture.

[@TeleporterM11]

@@TheoreticallyMedia yes it was a very good film.

[@mikewestbrook1142]

After you get over the gee-wiz how cool initial take, you realize just how badly this product needs work, lots of work. Sure, it's going to get better. Question is, how quickly. This project doesn't want to suffer the same funding pitfalls that has beset the very cool Instant Art AI project. Good news is, there are seemingly fewer players doing motion right now. Wish them the best with their efforts.

[@TheoreticallyMedia]

To be honest, I kind of hope that AI video takes off into a new direction. What direction that is? I have no idea...but I'd love to see it become something that isn't just replicating hollywood movies. There's the potential here for an entirely new art form-- which would be amazing to see... Time will tell...

[@mikewestbrook1142]

@@TheoreticallyMedia I think people want to create scenes, add voices, etc. At least the ones I've spoken with do. It's probably too much to ask to be able to create "shorts" that would include voices, but I know that's what everyone wants to start... then full movies.

[@michaelhalsey5884]

If you look at the difference between Midjourney 1 and 5 - about 9 months, you can see how quickly these things are improving.

[@freemodesettaigal18]

Can Put a Series That Film With A.I Please Make a Series or Playlist or Tutorial can You? Please

[@TheoreticallyMedia]

I’ve got a video that I’d like to do, putting together all these tools. Coming up soon!

[@andriian1762]

intrstng get up)))

[@DJ_MO]

I think gen2 is not yet available, just gen1

[@TheoreticallyMedia]

Correct. It's still technically in Beta-- although if we take the beta release pattern of Gen-1, I'd say it'll be publicly available in about a month. That said, toward the end of the video, I recommend joining the Runway Discord and being part of the community. They tend to let more people into the beta each week, and obviously grant access to those who are part of that community!

[@morris5648]

Vaporware?

[@TheoreticallyMedia]

Still kicking. Just a very long beta. I’m surprised and thought it would have launched by now

[@AntonioPerez-zk2mb]

So...I mean, it's over for analog commercial filmmaking industry. If this isn't a prank and this technology is still it's infancy then the first jobs to go will be film crews for commercials and music videos. Ad agencies are going to be all over this. Then gradually television and features starting with just laying in A.I. generated background and atmosphere -- terms for set dressing, vehicles, props and extras. Wow! This is absolutely unreal. Say goodbye to your film crew gigs over the next decade, folks, if you work in the industry.

[@TheoreticallyMedia]

My hope is, it'll turn into a mix. I think the first place you'll see it is in Animation. Something like Robot Chicken, or the type of shows on Adult Swim back in the day. Although, these days, it'll probably go straight to Netflix. But yeah, only a few steps from hour long dramas. To be honest, I hope a happy medium is found. I did work in Film/TV for over a decade. I still have friends in town who are currently not working due to the strike. But obviously, its a pretty massive and complex issue, a lot of which is driven by giant corporations who want profit for the least amount of cost...So...Yeah, I'm not optimistic.

[@AntonioPerez-zk2mb]

@@TheoreticallyMedia I'm IA and have been a grip (mostly) for 11 years and was a PA before that. I'd give it 5 years before we start seeing this tech seriously stripping away at manpower needs. There's just no way it's not.

[@TheoreticallyMedia]

@@AntonioPerez-zk2mb Wow, with that timeframe, there's a good chance we were on the same set. I did EPK/BTS as my bread and butter for a lot of years and was on sets all over the place. So, anyhow-- there was this quote by Joe Russo the other day where he claimed full-AI movies in 2 years. I was doubtful about it, until I realized that dude has made a billion dollar movie, twice. He's for sure in the camp of like, James Cameron, where tech companies are showing him bleeding edge stuff. Tech that we don't even know exists yet. So, yeah-- two to five years? I can see it. It's one of the things that I've been keenly watching re: WGA. The fact that studios aren't budging on AI. That is very telling. And to be fair, (I have no inside info on this, obviously) I don't think its the whole of the AMPTP. I think some companies, like Disney, Paramount and Uni do have a bit of that "Where dreams come true..." Hollywood legacy pride. But Amazon/Apple? They could care less. They're driven solely by tech and profit. Again, total speculation, but I think that will be the holdout. Particularly considered Apple and Amazon could easily weather a two year content drought while they wait for the tech to develop. (And actually, in the case of the WGA, I think AI screenwriting is really just months away...)

[@SmartExpertDesigns]

Has anyone thought that such leaps on this technology has something to do with Alien reversed technology?

[@TheoreticallyMedia]

I mean...I don't think so. But I HOPE so?

[@subhashtd1436]

Business man with Alien hands 😅

[@TheoreticallyMedia]

I love the weird AI!

[@Mat-fw1ky]

In the movie Westworld they could tell who wasn’t human by looking at their hands.

[@peped6607]

damn AI is scary!

[@TheoreticallyMedia]

Haha- I know, not quite there yet, which creates such a weird un-reality!

[@jenniferlambert3886]

Thanks for your videos - much appreciated. I really like the potential of MJ and other AI tools. I am just concerned by all the dark themes, genres, and palettes being outputted by these tools. Are the models only being trained on dark data? If so, is this going to change to serve other markets that are looking for something that is less doom and gloom?

[@TheoreticallyMedia]

Ha! Yeah, I hadn't thought about that-- I mean, it also might just be me. I do tend to lean toward that type of material. That said, your comment did get me thinking, and it might be two fold: 1) The generators have been trained on a lot of modern imagery, and you're right: that has been getting darker. In fact, I saw an article recently that was something along the lines of: "Your TV isn't broken, movies are just darker"-- and 2) With the darker images, its a lot easier to hide the flaws. There's only so much memory a bot can use for an image, so I wonder if it'll obscure details in shadows so it doesn't have to render them. Point taken though: I'll try to work on something with more of a happy tone in an upcoming video!

[@greenguider]

Some people say that artificial intelligence is good, while others say that artificial intelligence makes people less intelligent. But basically, if we consider the goal, it doesn't matter if there is artificial intelligence or not, the important thing is that we should always take steps towards getting better, whether with artificial intelligence or without that dear friend.

[@TheoreticallyMedia]

100% agree. I always take the stance that AI is a tool. From a creative standpoint, these AI generators can make very compelling images, but to have something viewers will relate to and enjoy, it will always take a human to craft a story.

[@greenguider]

@@TheoreticallyMedia Yes, you are exactly right. People who are always striving and looking for improvement always understand and use technology, but in the meantime there are people who are always just debaters and only destroyers, they just comment without any analysis and knowledge, there is nothing bad in The world does not exist, only our perspective on things is different and we see one thing as good and another thing as bad.

[@AJplays515]

0:40 what discord server is that?

[@TheoreticallyMedia]

That’s the RunwayML discord server. You can get there via the link in the description. It’s on their main page!

[@Mat-fw1ky]

In the 1973 movie Westworld they could tell who wasn’t human by looking at their hands.

[@rebelangel8227]

Now we just need to neurolink into AI and risk being turned into borg to turn what where thinking into movies games and what ever else AI can be used for...

[@TheoreticallyMedia]

Ha! I do sort of wonder what the adoption rate of something like Neurolink is going to be like. I mean, the first generation beta testers are in for a real gamble. Most people I know are like “cool, but no way” which, is the logical answer. I’d say it’ll take a literal generation (past our time) before we get anywhere near mass adoption of something like that.

[@AtomicPixels]

Hmmm…These are the things you start to notice in motion that you never once did.

[@freemodesettaigal18]

Bro can we abobe firefly please put tutorial

[@TheoreticallyMedia]

You want a tutorial on Firefly? I did do a video early on, basically when it launched. I should probably circle back and see how it’s come along. I wasn’t overly impressed at the time, but maybe it has improved?