Wild AI Video Workflow with Viggle, Kaiber, Leonardo, Midjourney, Gen-2, and MORE!

  Рет қаралды 13,541

Theoretically Media

Theoretically Media

Күн бұрын

Here's an interesting new AI Video Generator workflow utilizing Viggle.AI, Kaiber.AI, Leonardo, Gen-2 and Midjourney-- all inspired by Editor Colin Goudie's rip reel for Rouge One. By utilizing pre-existing films as references and styling them in a variety of AI Tools, we take a "kitbash" approach, but the results are promising, as you'll see in the examples. I'll walk you through everything I learned to hopefully save you time if you want to try this out yourself.
LINKS
Viggle Tutorial: • New Free AI Motion & A...
Viggle.AI: viggle.ai/
Kaiber.AI: kaiber.ai/?via=tim
Leonardo.AI: app.leonardo.ai/?via=tim
Runway Gen-2: runwayml.com/
AudioGen: www.audiogen.co/
Uncanny Harry: / uncanny_harry
Jeff_synthesized: / jeffsynthesized
Martin Haerlin: / martin_haerlin
00:00 Intro
00:28 Inspiration from Rogue One's story reel process
01:47 Recreating the "Are you not entertained?" scene
02:01 Overview of the A.I. generated scene
03:30 Using Viggle.AIfor the character animation
4:00 Issues with Viggle Output
4:58 Utilizing Leonado.AI for Character References
5:36 Solving the Shake with Kaiber.AI
6:54 Creating Backgrounds
7:35 Using Gen-2 for Background Motion
8:33 Tips on Comping Green Screen AI
9:53 Audio Generation and Free Tools
10:55 The Soundtrack
11:10 Concluding Thoughts

Пікірлер: 124
@johntnguyen1976
@johntnguyen1976 2 ай бұрын
“Ai Kitbashing with Tim” needs to be a legit series on the channel! I’ve tried pretty much all of your process kitbashes and have advanced the quality of my output each time.
@TheoreticallyMedia
@TheoreticallyMedia 2 ай бұрын
That's awesome to hear! And yeah...hmmm, a kitbashing show DOES sound fun!
@MetaPuppet
@MetaPuppet 2 ай бұрын
Running the viggle output through Kaiber to clean it up is a nice trick. Thanks for the info!
@GoldenbellTraining
@GoldenbellTraining Ай бұрын
This was really amazing! Thanks -- I used your kitbashing to do some interesting things in my last video!
@mrbabyhugh
@mrbabyhugh 2 ай бұрын
0:44 confession.... Rogue One is the FIRST Star Wars film I ever watched in it's entirety (after decades on earth). This came after I watched The Mandalorian and got intrigued. Was so impressed after Rogue One, I ended up watching every non animated Star Wars film ever made!
@ChristopherCopeland
@ChristopherCopeland 2 ай бұрын
How cool! That’s an experience I’m quite jealous of. My experience of Star Wars sadly has been one of diminishing returns. It was my entire childhood though, so idk who I’d even be without it haha
@dsoprano13
@dsoprano13 2 ай бұрын
Rogue one is my favorite Star Wars movie. They did so many things right.
@MartinZanichelli
@MartinZanichelli 2 ай бұрын
Shouldn´t you start with Episode Zero? Isn´t that the first movie historically speaking?
@zdenekburian1366
@zdenekburian1366 2 ай бұрын
@@dsoprano13incredible, it is the only non-animated among star wars movie/series i tried three/four times to watch and never arrived past the first half an hour. My preferred is the empire strikes back. And i'm there since the beginning in 1977
@zdenekburian1366
@zdenekburian1366 2 ай бұрын
@@MartinZanichellihhhaahhhaha
@kiofsea1861
@kiofsea1861 2 ай бұрын
As I delve into storytelling and video experimentation, VideoGPT seamlessly integrates into my process, enhancing my content with its subtle touch of sophistication.
@mrbabyhugh
@mrbabyhugh 2 ай бұрын
3:15 OMG you are EVUL!!! I NEVER knew that film even existed, now you burn my brain with that visual !! LOL
@TomasSowellIsGreat
@TomasSowellIsGreat 2 ай бұрын
My eyes, my eyes!!!
@TheoreticallyMedia
@TheoreticallyMedia 2 ай бұрын
Haha, I'm so sorry!!
@DataJuggler
@DataJuggler 2 ай бұрын
I think this is neat and all, if content creation is all you care about. To me though, it feels like letting a chess engine play for you. The fun to me of animating is watching it all come together.
@OldmanJohnnyMorgan
@OldmanJohnnyMorgan 2 ай бұрын
can't wait to try this out, thank you!
@TheoreticallyMedia
@TheoreticallyMedia 2 ай бұрын
It's a LOT of fun! Can't wait to see what you generate!
@RussianQueenIrina
@RussianQueenIrina 2 ай бұрын
His hand motion with 3 fingers!!!! And so blurry! Tim, you are so bright! Open AI should be all over you for you to test their SORA and be an ambassador! I am sure you could create a good film with SORA
@TheoreticallyMedia
@TheoreticallyMedia 2 ай бұрын
I keep tweeting at Sam Altman, but he ignores me! haha, I even offered to write him a check for 7 Trillion Dollars!
@RussianQueenIrina
@RussianQueenIrina 2 ай бұрын
@@TheoreticallyMedia you know what, man! I truly want to see you on Mars building the colony. I am going to be working there by your side!
@johnsknox
@johnsknox 2 ай бұрын
non stop gold. thanks once again
@TheoreticallyMedia
@TheoreticallyMedia 2 ай бұрын
Thank you!!
@theawarehousestudio
@theawarehousestudio 2 ай бұрын
Great video. Love getting inspiration for new types of workflows like this. (Even when it is snowing.)
@TheoreticallyMedia
@TheoreticallyMedia 2 ай бұрын
Thanks so much! Still a lot of fine tuning with this method, but I wanted to get it out there to see what others might do with it. I love this free-for-all era of kitbashing! So many opportunities for everyone!
@markusps3248
@markusps3248 Ай бұрын
Small correction on Tarkin in Rogue One... It was not a deep fake, it was a full CG face replacement made by ILM. To my best knowledge the first time deepfake was used in Star Wars, was for young Luke Skywalker in "The Mandelorian" and later in an episode of "Book of Boba Fett".
@TheoreticallyMedia
@TheoreticallyMedia Ай бұрын
Very valid point! And ha, yeah-- that Luke didn't work out too well the first time around. He did look much better in Book of Boba though! (didn't they hire the guy that did the better version?)
@markusps3248
@markusps3248 Ай бұрын
@@TheoreticallyMedia The reports to what degree KZbinr and master of Deepfakes Shamook was involved vary between "He was adiving" to "He did it himself". But he definitelly helped ILM to work out a better version in Book of Boba Fett.
@TanChoonHong
@TanChoonHong 2 ай бұрын
Great walk-through. Pretty intriguing! Looks like AI video generating is progressing at a steady clip. Thanks for sharing.
@cheneffective1983
@cheneffective1983 2 ай бұрын
just not long ago i started workflow similar to this, but the extra last step you did there is amazing!!!!!! thank you so much💚🙏
@TheoreticallyMedia
@TheoreticallyMedia 2 ай бұрын
Excellent to hear! Still thinking of a few other details to add in as well! We're all on the front lines here, and it's really exciting to see all the crazy directions we're taking things in!
@cheneffective1983
@cheneffective1983 2 ай бұрын
absolutely!! and i love how you getting out of the box with the use of the tools, and not only that, you learn the new ones so fast and then teach others that's amazing, big respect🤓🤝 @@TheoreticallyMedia
@videos6505
@videos6505 2 ай бұрын
Well done!
@TheoreticallyMedia
@TheoreticallyMedia 2 ай бұрын
Thank you! Next reference film: Master and Commander! Let’s go through all the Russell Crowe films! Haha
@circelink
@circelink 2 ай бұрын
Brilliant workflow walkthrough! And Rogue One thrills if no other reason than Phoebe Waller-Bridge! (Many other reasons imho!)
@TheoreticallyMedia
@TheoreticallyMedia 2 ай бұрын
Thank you so much! There’s a lot to still fine tune here, but I thought it’d be great to get the ideas out there for others to play with and add to! I love this wild era of AI video!
@MONTY-YTNOM
@MONTY-YTNOM 2 ай бұрын
Nice tutorial mate
@EnigmasEpiphany
@EnigmasEpiphany 2 ай бұрын
Excellent!!
@henryolsson1747
@henryolsson1747 2 ай бұрын
Having a real hard time finding the Terminator Dance Off video, really want to see it 😆
@TheoreticallyMedia
@TheoreticallyMedia 2 ай бұрын
I got you! twitter.com/Martin_Haerlin/status/1774785858572349692
@henryolsson1747
@henryolsson1747 2 ай бұрын
@@TheoreticallyMedia Thank you!
@adventurelens001
@adventurelens001 2 ай бұрын
"I've lived with it for a very long time" 😆
@TheoreticallyMedia
@TheoreticallyMedia 2 ай бұрын
Haha! Now others can share in my trauma!
@harrygoldhagen2732
@harrygoldhagen2732 2 ай бұрын
Nice job, Tim! Your film reminds me of those classic cars in Cuba that are built out of anything they can get their hands on for cheap or free. I think it's great that you're trying so many tools. Eventually I imagine that some tools will simply shine and be the preferred ones for this kind of work. Anyway, bravo!
@TheoreticallyMedia
@TheoreticallyMedia 2 ай бұрын
Haha. You ever hear that Johnny Cash song “One Piece at a Time”- where he’s working at the Cadillac factory and steals one part every day, but it takes him 20 years to assemble the car!
@SpaceFairyness
@SpaceFairyness 2 ай бұрын
Zardoz!!! Classic 70s scifi! I own it on BluRay, it's glorious 😂
@Crazy_Truth
@Crazy_Truth 2 ай бұрын
What about shadows and lighting in Viggle;?
@TheoreticallyMedia
@TheoreticallyMedia 2 ай бұрын
Good question! I think that it is established in your reference photo. I’ll test it out with some heavy film noir shadows on a character to see what happens.
@jcehlert
@jcehlert 2 ай бұрын
Well played Tim. Do you think you'll be able to keep the character consistent through more short films? I am motivated to try the kitbash workflow.
@TheoreticallyMedia
@TheoreticallyMedia 2 ай бұрын
More or less. Kaiber can be a bit finicky, but the 3.0 update is super early. Hoping they get that locked down soon!
@davidcooke8005
@davidcooke8005 Ай бұрын
Dat's a real purty guitar behind you.
@shadyendeavor
@shadyendeavor 2 ай бұрын
Is there a reason why you didn't use the Speech to Speech in ElevenLabs using your own voice? I use that all of the time to get what I need and your tone in the recording does a great job in effecting the output voice.
@TheoreticallyMedia
@TheoreticallyMedia 2 ай бұрын
I did try with my own voice, but it was still coming out garbled. My have been because I was yelling? It was the first 11labs major fail I’ve had in awhile. Surprised me!
@ECHSBACHS
@ECHSBACHS 2 ай бұрын
Kitbashing is our friend. : )
@TheoreticallyMedia
@TheoreticallyMedia 2 ай бұрын
Kitbashing is THE Best! Uncanny Harry had a pretty good quip about it: In 6 months our Kitbashing will be incorporated into the platforms-- so for now, we're all leading the charge and showing the way!
@ECHSBACHS
@ECHSBACHS 2 ай бұрын
@@TheoreticallyMedia :)
@Kenb3d1
@Kenb3d1 2 ай бұрын
Enjoyed the video, since trying out Viggle I've been contemplating a similar workflow. Using Facefusion and then Topaz with Iris over the top solved the face, but ive yet to find a better method to improve the body.
@armondtanz
@armondtanz 2 ай бұрын
Comfyui just released one. I havent downloaded it but it looks amazing.
@christopherpoet458
@christopherpoet458 2 ай бұрын
I am actually going to have to watch this twice. Maybe a third time. I think I will try something with this method but I don't have all the software mentioned or alternatives. Do you know if I can do the lighting corrections and stuff in Wondershare?
@TheoreticallyMedia
@TheoreticallyMedia 2 ай бұрын
Filmora? They should have color correction tools! It's been awhile since I've used it, but I'm almost certain it is there!
@christopherpoet458
@christopherpoet458 2 ай бұрын
@@TheoreticallyMedia i will find out soon enough! Haha I won't complain if not though. I like the idea of this workflow for concept films or concept trailers.
@Dr.UldenWascht
@Dr.UldenWascht 2 ай бұрын
6:06 *Duane* Johnson? My man is really testing the limits of AI.
@TheoreticallyMedia
@TheoreticallyMedia 2 ай бұрын
Ever see his Epic Cheat Day meals? I love looking at those. Sadly, I just want to eat them without doing the 6 months of workouts! Haha, I’ll just take the food please!
@itumelengnkabinde
@itumelengnkabinde 2 ай бұрын
it may be better to use runwayml to get a cleaner greenscreen
@TheoreticallyMedia
@TheoreticallyMedia 2 ай бұрын
I was thinking the same. Might have to revisit this once I have a few other tools to bash it with!
@darksydeflow
@darksydeflow 2 ай бұрын
Are there any other ways to reduce the stuttering/shaking output from Viggle without having to change the style/look of it too much?
@TheoreticallyMedia
@TheoreticallyMedia 2 ай бұрын
Not as of yet-- but I'm hoping there will be some model improvements soon!
@LouisGedo
@LouisGedo 2 ай бұрын
2:58 😆 🤣 😂 That's awesome!
@TheoreticallyMedia
@TheoreticallyMedia 2 ай бұрын
Martin killed it there! Literal spit take from me!
@LouisGedo
@LouisGedo 2 ай бұрын
@TheoreticallyMedia 😆 🤣 😂 Deservedly so....... just insanely funny to watch!
@Mrim86
@Mrim86 2 ай бұрын
I love where your head is at and I'm super impressed by the work that went into this video, but man do I hope LTX solves all these workarounds
@adrienbiosseduplan9666
@adrienbiosseduplan9666 2 ай бұрын
love
@TheoreticallyMedia
@TheoreticallyMedia 2 ай бұрын
Thank you!!
@AK47_64
@AK47_64 2 ай бұрын
Not getting access of LTX Studio! 😢
@TheoreticallyMedia
@TheoreticallyMedia 2 ай бұрын
The big roll out should be this week and next! At least that's what I've heard!
@AK47_64
@AK47_64 2 ай бұрын
@@TheoreticallyMedia can you please help me to get access!!
@Ryoku1
@Ryoku1 2 ай бұрын
How would this process handle a fight scene?
@TheoreticallyMedia
@TheoreticallyMedia 2 ай бұрын
I’ll try it out. Hypothetically, you might end up with the same character? Since Viggle only allows one reference. But what happens if we put in a reference with 2 people? Might break, but I’ll give it a shot.
@Ryoku1
@Ryoku1 2 ай бұрын
@@TheoreticallyMedia would it be possible to break the fight into two clips for each character?
@zippythinginvention
@zippythinginvention 2 ай бұрын
​@@TheoreticallyMediaall of these Style Transform suites seem to process at 8fps and then interpolate. So, quick movements are... difficult.
@Crazy_Truth
@Crazy_Truth 2 ай бұрын
Have you subscribed every model! 😲
@TheoreticallyMedia
@TheoreticallyMedia 2 ай бұрын
Haha, basically yes. I beta test for a few of them as well. But, yeah-- somehow I've turned all of this into a job, so I've got to stay on top of them all!
@Crazy_Truth
@Crazy_Truth 2 ай бұрын
@@TheoreticallyMedia habibi! Too much money!! 😂
@LouisGedo
@LouisGedo 2 ай бұрын
👋
@TheoreticallyMedia
@TheoreticallyMedia 2 ай бұрын
Heya Louis! Thoughts on this AI video workflow?
@LouisGedo
@LouisGedo 2 ай бұрын
@TheoreticallyMedia It's not my cup of tea. I'm definitely willing to wait a couple / few years for SORA quality text to video to come to the little people like me......especially when we get that quality in Open Source!!! 👍
@LouisGedo
@LouisGedo 2 ай бұрын
@TheoreticallyMedia I didn't jump on board text to image until I saw sufficiently high quality being regularly generated by some of the tools. Time is precious and I feel it's a waste of MY time to play around with tools that are too cumbersome or not sufficiently good quality producing tools. That's just me. I was blown away by SORA...... and that's the standard I seek in order to get heavily involved (time and $$ wise) with an AI video tool.
@LouisGedo
@LouisGedo 2 ай бұрын
@TheoreticallyMedia I definitely find there's a good selection of sufficiently good quality text to image tools available now and that's why I've spent a lot of time and $ on software tools subscriptions and hardware tools (like an HP Workstation with a lot of GPU under the hood). Once I get access to RELIABLE and cost effective SORA quality tools, I'm all in on AI video...... trust me on that.
@FSK2
@FSK2 2 ай бұрын
This video made using viggle ai kzbin.infoO5IeRNPpP7Y?feature=share
@ProudSkittles
@ProudSkittles 2 ай бұрын
*dwayne
@TheoreticallyMedia
@TheoreticallyMedia 2 ай бұрын
Man, I had to see that 3000 times while editing, was kicking myself every time! That said, I’ll say that the overall point is that the name seems to work more as a placeholder to get Kaiber to create a somewhat consistent character. Not making excuses, apparently I cannot smell what he is cooking!
@MrNeighSayer
@MrNeighSayer 2 ай бұрын
Tarkin wasn't deepfaked, it was traditional CG and based on a cast of Peter Cushing's face. KZbinrs have made deepfaked improvements though.
@TheoreticallyMedia
@TheoreticallyMedia 2 ай бұрын
Very good clarification-- I called it a "deep fake" as that is sort of what the media reported it as, but you are totally right, it is more akin to a CGI character that was mocapped. That said, it is funny how random YT'ers (and not so random ones like Corridor Crew) have done the same with better results!
@MrNeighSayer
@MrNeighSayer 2 ай бұрын
@@TheoreticallyMedia Didn't mean to be all "Ackshually..." about it. 😂 Had deepfakes been more of a thing back then, it would have looked a hell of a lot better! As it stands, he's right out of the uncanny valley, with only a few shots looking somewhat passable.
@moismailx
@moismailx 2 ай бұрын
100000x easier to go out and shoot this scene
@TheoreticallyMedia
@TheoreticallyMedia 2 ай бұрын
Haha. Not gonna lie, I often think that as well in the middle of one of these. But I think when you look at it as animation, or like, heavy VFX/Green screen films, there’s some time saving (and cost) here. Especially if you’re a “garage filmmaker”
@CartooonTHAT
@CartooonTHAT 2 ай бұрын
2nd
@TheoreticallyMedia
@TheoreticallyMedia 2 ай бұрын
No Chicken Dinner, but I'll buy you a burger!
@ECHSBACHS
@ECHSBACHS 2 ай бұрын
@@TheoreticallyMedia I will gladly pay You next Tuesday for a hamburger today. : )
@leandrobohorquez2111
@leandrobohorquez2111 2 ай бұрын
Where do you thing AI is going to be in 2040, 2050
@TheoreticallyMedia
@TheoreticallyMedia 2 ай бұрын
Man, I can’t even fathom where it’ll be next month!
@I_AM_MALACHI
@I_AM_MALACHI 2 ай бұрын
Third
@TheoreticallyMedia
@TheoreticallyMedia 2 ай бұрын
No chicken dinner! As the third, you do have a vegetarian option though!
@BabylonBaller
@BabylonBaller 2 ай бұрын
Damn brother, We still have a longggg way to go, 2:05 quality is awful lol Sora... Where are youuuu, we're drowning over here
@TheoreticallyMedia
@TheoreticallyMedia 2 ай бұрын
Haha. Always remember, just where we are today. And I always caution: Sora (if/when we get it) is probably going to be pretty janky.
@BabylonBaller
@BabylonBaller 2 ай бұрын
@@TheoreticallyMedia I can see that. I'm also pretty sure consistent characters in Sora is going to be in a real distant future. Like years lol Even if the technology allows it, Hollywood will not. If you think the strike was ugly from the script writers, imagine how bad the actors strike will be!
@armondtanz
@armondtanz 2 ай бұрын
Furst
@TheoreticallyMedia
@TheoreticallyMedia 2 ай бұрын
You have WON the Chicken Dinner! Sending out via Fed Ex tomorrow! You may get it....next month?
@armondtanz
@armondtanz 2 ай бұрын
@@TheoreticallyMedia in UK :(... can u send thru dropbox? Or we transfer?
@VulgarTruth
@VulgarTruth 2 ай бұрын
3 fingers and a thumb😅
@aicarpool
@aicarpool 2 ай бұрын
Tim I’m shocked you never talked to me for any content. I make way more content than these guys, I also helped Pika train data and was the head moderator and artist for them. We talked a bunch..
@TheoreticallyMedia
@TheoreticallyMedia 2 ай бұрын
Ahhh- Microphonist! I didn't realize you were here! I'll drop a follow on your channel! Are you on X as well?
@zippythinginvention
@zippythinginvention 2 ай бұрын
​@@TheoreticallyMedia oh, wow! I didn't realize you were a Head Mod, Mikey. You were so seldom present, I'm surprised. And, a Data Scientist too? Wow. I clicked a lotta thumbs. Can I put that on my resume?
@tright6
@tright6 2 ай бұрын
Horrible to use other people's work without their permission just to replace them entirely
@ChristopherCopeland
@ChristopherCopeland 2 ай бұрын
This is what literally everybody does to create anything, even if it’s just subconsciously and it never makes it out of their head before it becomes what they’re trying to create. It’s also what people do when they use temp music on movie edits before the composer comes in to replace the music, very often replacing the music with something very similar. I do understand what you mean, but this is basically just a higher Fidelity version of what people have been doing for decades, if not the entirety of human history
@tright6
@tright6 2 ай бұрын
@@ChristopherCopeland The thing is. AI is not inspired like humans are, because AI does not like anything. It sees trends in the data its fed and outputs an approximate results of what something a human made might look like.
@techiechar
@techiechar 2 ай бұрын
****immediately searches for Zardoz and...oh no....
@TheoreticallyMedia
@TheoreticallyMedia 2 ай бұрын
Haha. I’m so sorry. I should have left that sleeping dog be!
Midjourney: Consistent Characters & Kaiber 3.0
13:37
Theoretically Media
Рет қаралды 35 М.
2000000❤️⚽️#shorts #thankyou
00:20
あしざるFC
Рет қаралды 16 МЛН
IS THIS REAL FOOD OR NOT?🤔 PIKACHU AND SONIC CONFUSE THE CAT! 😺🍫
00:41
Countries Treat the Heart of Palestine #countryballs
00:13
CountryZ
Рет қаралды 30 МЛН
The Ultimate AI Film Platform: LTX Studio Deep Dive!
14:27
Theoretically Media
Рет қаралды 34 М.
The $15,000 A.I. From 1983
22:04
Popular Science
Рет қаралды 373 М.
Creating Full Page Comic Books with AI
12:04
Evan Ezquer
Рет қаралды 12 М.
AI vs Artists - The Biggest Art Heist in History
44:23
Yes I'm a Designer
Рет қаралды 327 М.
New AI Video That Does Everything!
10:36
Theoretically Media
Рет қаралды 49 М.
I Talked To Adobe About Sora, Gen-2, Pika, and the Future of After Effects
15:52
AutoGen Studio: Build Self-Improving AI Agents With No-Code
27:06
23 AI Tools You Won't Believe are Free
25:19
Futurepedia
Рет қаралды 1,9 МЛН
The Best FaceSwapper yet! And it’s FREE!
9:19
Theoretically Media
Рет қаралды 126 М.
What AI Image Generator Should YOU Be Using??
48:30
Matt Wolfe
Рет қаралды 281 М.
#miniphone
0:16
Miniphone
Рет қаралды 3,2 МЛН
ПОКУПКА ТЕЛЕФОНА С АВИТО?🤭
1:00
Корнеич
Рет қаралды 2,6 МЛН
Неразрушаемый смартфон
1:00
Status
Рет қаралды 1,2 МЛН