AI Video Motion Goes x5! New Video Generator / AI Sound Effects, & More!

[@sigma_z]

I must say that out of all the new KZbin channels where people talks about AI, your videos are the only ones that I can actually sit and watch through. All the others are just too gimmicky and does not deliver enough value. Your summaries are great and my creative brain is already buzzing from all the possible ideas. Thank you!

[@TheoreticallyMedia]

Oh, thank you so much! Really appreciate that! And hey, man-- that Despacito piano cover on your channel is KILLER!

[@Themakinfamily.]

I agree. I don’t watch many videos, but his videos are informative and straight to the point without wasting time.

[@lukewilliams7020]

The other AI KZbinrs are so painfully excruciating to watch. This is my sanctuary right here ha

[@sigma_z]

@@TheoreticallyMedia omg, my despacito cover 🙈 that video is from so long ago. I really meant to get into KZbin but never found the time. Maybe this year. 😅 And bro, YOU DA MAN. Please keep your videos coming! 💪🏼

[@timetravel3964]

Thank you so much , I follow you from Iraq

[@JeffSynthesized]

Great video as always, Tim. Thanks for the shout out. That sound fx AI is a game changer too.

[@TheoreticallyMedia]

Dude, thank you so much for that awesome reel! I got super behind today with some other research (plus the kids were ALL OVER ME today)-- Thankfully, as soon as I saw your video, I was like: "Well, I'm not going to do better than THAT!" Yeah-- the SFX thing is INSANE. The timing on the footsteps was a tad off-- but I mean, that is so nitpicky. Also, Rose totally killed Jack.

[@BrunoCailloux]

@@TheoreticallyMedia Great video as always ! but have you the link of Sonic Vision LM plz? I didn't found it ...

[@ChrissieAiArt]

@@BrunoCaillouxI can’t find it either :(

[@AllanMcKay]

I didn't actually know that about sizzling bacon being used for rain sound effects during a foley session, learn something new every day! Great job as always mate! Hope you're doing great! :)

[@TheoreticallyMedia]

Yup! Picked that one up from a sound design guy years ago, and now I can never NOT HEAR IT. Sorry, I might have either ruined rain, or improved bacon for you!

[@Apuat]

I am loving how Gen 2 and some of the other AI video programs are evolving, but the next step I will be really excited about will be the ability to maintain photo resolution. I’ve done a couple of spec projects for clients using photos and they really disliked the the overall blurry, softness, and loss of detail with AI animated videos.

[@TheoreticallyMedia]

Same! I’m hoping that’ll be worked out fairly soon. From what I’ve seen in the research pipeline, I’m thinking anywhere between 3 and 6 months.

[@Apuat]

@@TheoreticallyMedia sounds like a realistic timeline. 😂

[@JohnVanderbeck]

I really like what Runway is doing because it is not just another "make video" AI but rather a tool for making motion from images. We had some VERY nascent tools for doing that before the AI craze but they weren't very good and kind of died off. As a Photographer I really enjoy these tools as they let me get more life out of my work.

[@TheoreticallyMedia]

Do you remember that whole Tumbr craze of lightly parallaxing a portrait? I mean, that's basically a lot of this stuff. Nothing really new, just a TON easier. I think stuff like motion brush is the thing that will really push us into the next era. Particularly when you can prompt for action in the brush. Combine that with a merging of 3d (which I think is going to be big this year)-- and I mean...let the good times roll! On the photo side, man-- that Ambient slider in Gen2 is REMARKABLE for landscape shots.

[@HumanAki]

Godzilla a freak 🤣🤣🤣 Thank you for always keeping us updated on key breakthroughs. Stay awesome!

[@TheoreticallyMedia]

Thank you! And seriously, who knew Godzilla had such a wild side?!

[@echopeakbicycling85]

One of the most interesting channels I've subscribed to recently. Well presented, thank you

[@TheoreticallyMedia]

Thank you! That means a lot!

[@gnarlymode]

Now if the sound thing could generate that stuff and put each individual audio file it used on separate tracks to then be able to manipulate, it would be a sound editors dream.

[@TheoreticallyMedia]

Completely. Basically, like a sound effects library right at your fingertips. I think to get to true pro work, that'll need to happen, as sound designers will want to add reverb and other effects as well...

[@gnarlymode]

@@TheoreticallyMedia Where this would really take off is if the AI could analyze the footage, then use the database of the editor's sound library to cut. A sound designers library is their bread and butter, because they've compiled and recorded most of it themselves over many years. I'm already using AI for dialogue work in film. Speeds things up a ton.

[@TheoreticallyMedia]

@@gnarlymode I’m actually surprised that hasn’t happened yet! Seems like between metadata and tagging, that’s a job AI was born to do!

[@MrRobertC]

Good video thanks. Here’s my dilemma - these tools are in a horse race. This week it’s Runway, last week Leonardo, week before Pika. I need to subscribe somewhere but with the rate of changes coming exponentially how do I place my bet. Changing is not hard but still, we develop a feel on how to use a product over time. Really dunno how to approach. What are other people doing?

[@TheoreticallyMedia]

I hear you-- I've been saying its a bit like the Streaming Wars. At this point, to reasonably do it on a budget is to ala-carte them month to month. Netflix, binge, cancel, Disney, binge, cancel, etc. You almost have to juggle them...or-- maybe give up grocery shopping? (kidding, of course. I also have kids-- they eat EVERYTHING...)

[@theframedarts5362]

This is fire man! 🔥 I'd love an upscaler being used with the last one.

[@TheoreticallyMedia]

That is totally something I can't wait for either! Once those two tools are combined? Man...huge!

[@DriesduPreez]

9:44 Is there an AI that does the 'opposite'? Identify sounds and generate text and or images/video from it?

[@TheoreticallyMedia]

I haven’t seen that yet, but I’m sure someone out there is working on it. If I do see it, I’m totally going to make some movies out of some old public domain radio drama broadcasts!

[@TeddyLeppard]

Short and to the point. These are good summaries.

[@TheoreticallyMedia]

Thanks! I do hate the whole 40 minute video thing. I know that KZbin tends to like it, but man-- I've got to edit these things, and I can't take myself for that long!

[@deltamack]

“Godzilla like it round”!!!!😅😂🤣😂🤣😂🥰👏👏👏❤

[@TheoreticallyMedia]

Even Godzilla got to shout!

[@TheeRebel]

Ayo!!! Ur funny, U are my guy TIM, quality content every damn time. The lil tidbits you add are so useful also! You are appreciated.

[@TheoreticallyMedia]

Oh, bless you! Thank you so much! And glad to hear! It was probably the weather, but I think I was a little extra spicy today!

[@noobicorn_gamer]

lol the 2 second slow horses totally got me off guard and it had a super great I should watch it effect on me

[@TheoreticallyMedia]

It’s pretty great! Gary Oldman is such a cranky character! Totally hilarious- but, the show does tension incredibly well also. Also, gotta love the shorter format. I think the first season is like, 6 episodes, so it’s super easy to binge through!

[@virgilxavier1]

I would love to see a duomo deep dive. I'm most interested in style transfer consistency between different shots.

[@TheoreticallyMedia]

Noted! I actually do want to dive into that as well. I saw some promising stuff when I was experimenting.

[@circelink]

As always, you rule! Perhaps a deep dive to compare Kaiber to Domo? And I had to pause the vid to go and see the new Runway update, it's RAD!

[@TheoreticallyMedia]

Totally! I need to circle back to Kaiber! It’s been a minute since I’ve played with it and there have been a lot of improvements over there! Runway is insane!!!

[@HolyGround777]

Your upload schedule consistency is very admirable! Great video as always😊

[@TheoreticallyMedia]

Thank you! I'm really pushing for Tues/Thurs this year. I've experimented around, and that seems to work best for me. I've tried pushing 3 videos a week, but that takes a pretty heavy toll and starts to border on burnout-- For me, 2 a week seems to be the sweet spot!

[@WifeWantsAWizard]

Great video. (3:30) A "paw" is an animal hand or foot that has nails or claws. So that checks out. (6:29) Watch the background in that pan shot with the guy in the suit. It is stunning that none of those business signs morph or dissolve. That is incredible.

[@TheoreticallyMedia]

You just answered the most important question of all time. Godzilla has a paw. Wow.

[@WifeWantsAWizard]

@@TheoreticallyMedia I do what I can.

[@vitalef]

Great piece, excited to try them all!

[@Arperture]

Thanks

[@TheoreticallyMedia]

Oh man, thank you so much!! Really appreciate that!!

[@CaptainHaHaa]

Jeffs a champion, I'm a big fan of his work he's always pushing the boundaries, Huge news on the sound fx front I can't wait to try this.

[@icvideoservices]

Yes please for a deep dive on Domo!

[@TheoreticallyMedia]

Noted! I'll put it on the to-do list!

[@FewFew77]

You give the most interesting ad read by providing a tutorial on how to use the product

[@TheoreticallyMedia]

Oh, thanks! Yeah-- I wanted to do something a little different-- I know there have been a few other channels that have covered Invideo, but none of them went full Zombie! Haha

[@soulipsyz]

Link to Sonic Vision LM? Can't find it

[@icvideoservices]

Really excited about the motion brush changes, but the morphing is still the biggest issue. Although I just sent off a music video to a band in the UK that I created entirely with MJ & GEN2 and because they play stoner rock, the morphing actually helped match the trippy music.

[@TheoreticallyMedia]

Hah, I feel the same! I think when you have a technical challenge (like morphing) the best case is just to lean into it. Turn it into an asset. But, yeah-- I also listen to (and have played in) a bunch of psychedelic and stoner bands, so I totally get that lava lamp visuals matching perfectly there. But, I also think if you can ramp down the morphing, it also works for like, Lofi, meditation, etc. I did see a guy put together a REALLY cool Synthwave track with Kaiber visuals that were all beat matched to the morphing. That was really cool.

[@AG_before]

🤣

[@AllanGildea]

Cheers, Tim!

[@LynnRogoffGreenKids]

Where can we find Soinc Vision LM?

[@isajoha9962]

LOL @ Godzilla booty. 🤣 5 brushes kind of awesome and a very cool step forward for Runway. Now it is possible to extend movement in a serious way beyond just the background. 👍

[@TheoreticallyMedia]

I keep imagining a text prompt box under each of those brushes. When that happens? Man...TO THE MOON!

[@micbab-vg2mu]

Thank you for the video - the biggest problem for me is that after 2 seconds a video quality drops - I wander why they can not fix it.

[@TheoreticallyMedia]

Yup, and on an extend, it gets even fuzzier. I think that'll be solved by mid-year. Fingers crossed!

[@micbab-vg2mu]

this is a matter of time:)@@TheoreticallyMedia

[@libertybelleband]

Very cool mate..

[@TheoreticallyMedia]

Thank you!

[@aymanfayed2317]

Good morning Tim, good work I always have a question, if you notice in architecture animation how they move the building when they walk through, is any idea or any chance to give us a clue how that can be happened in AI? I am really confused and interested at the same time, grateful to you

[@renzocheesman6844]

"Flow guided Dynami.. I'm not reading that whole thing" im dying

[@TheoreticallyMedia]

Haha, I'm not naming names, but you KNOW there are other AI channels that would have read that whole thing off for the extra ad time! Not me-- mostly because I have to edit myself, and-- no way am I going to bore myself reading that!

[@rastanz]

A Bruce Lee Terminator movie would be awesome 😆

[@TheoreticallyMedia]

Oh, totally. It was an example from this video I did on Plotdot, which is a AI Screenwriting Tool! It was a fun video, and I really DO want to see this movie: kzbin.info/www/bejne/l3LHgHaBo52ZapI

[@PunisherSM]

Could you use AI to separate the smoke into a layer? Clearing up the image could help with the AI animation of Godzilla, then add the animated layer of smoke back in. I've never used video editing, but I'm curious if someone who knows what they're doing could test that idea.

[@AlexBuzunov]

link to runway?

[@TheoreticallyMedia]

runwayml.com/

[@clint-hw4wk]

man, I have friends in the Foley industry. this is sad for them whilst at the same time great for independents (pros will be impacted hugely and the jobs lost will not come back).

[@TheoreticallyMedia]

Oh, I hear you. It was kind of bound to happen at some point. That said, there is always going to be a need for recording, and they have transferrable skills. Funny story: An old pal of mine was an audio editor and once had a client that made libraries of ducks squaking. Litereally, someone was out in the field, recording all manner of ducks-- which, my pal had to edit, and categorize by duck types and calls. 8 hours a day...listening to ducks. For him, that's a job he'd rather have AI do! haha

[@clint-hw4wk]

@@TheoreticallyMedia ya foley (or any) grunt work can be a pain but also the creativity like the frying bacon could be the magical result maybe those duck sounds will become the sound of EV scooters so they don't get hit by cars. My wee story, i was visiting the studio once and my belt made it onto the big screen as a slap sound effect (not as creative as the bacon sound but it was my belt). thanks for this video and your others. We live in wild times with technology and you help give some direction.

[@LofiLoungeLegends]

Where is the links at?

[@TheoreticallyMedia]

in the description.

[@LofiLoungeLegends]

All I see is a affiliate link for Invideo.

[@jeffg4686]

how close is it to getting what you actually want. I don't know if they do it on purpose or not, but I'm working with DALLE now and it can't follow instructions. It CAN generate some really interesting graphics. But it won't follow instructions. Also, do they "stamp in" any metadata or stuff to say it was generated with AI and you have essentially no protection. I tried Adobe's firefly, and it's VERY rudimentary at this point, AND they throw in this notification with every generation that it was marked as generated with AI (and thus you have no protection on it even if you are just having it modify a very small portion of your graphic)

[@TheoreticallyMedia]

Beyond the watermark, I’m not sure. I think when I looked at the file sizes, I saw something related, but ultimately, if you take video generated with any AI platform and then edit it in a NLE (Final Cut/Premiere ect) any file data will get wiped out

[@jeffg4686]

@@TheoreticallyMedia - yeah, I gotcha about the re-rendering in something else which is what I do anyways for touch ups and adding things, but I just think the law needs to change around AI. Some can take an entire day to generate the image you want. We don't want people just saying - I'm going to use it too because it was made with AI. a 3 word text prompt is one thing. I full page prompt and not using any celebrities and such, and even using control net or comfy UI to get more control over your art generations. I just don't understand the law on this...

[@MONTY-YTNOM]

Another good video mate

[@TheoreticallyMedia]

Thank you! I had a pretty stupid amount of fun putting this one together. The return of scandalous Godzilla!

[@MONTY-YTNOM]

His twerking is getting better @@TheoreticallyMedia

[@Shakalakahiki8]

Multi motion is great!

[@TheoreticallyMedia]

It's really nuts! I need to spend some more time with it, but I got buried under a bunch of other research! Luckily, it looks like a pretty major snow day tomorrow, so I'll have some time to... All Work and No Play Make Jack a Dull Boy... ...sorry, what was I saying?

[@jeffscott3186]

Love your videos, but Godzilla has hands at the ends of those stubby arms, not paws. Other than that, great video. And yes, I have watched too many Godzilla marathons.

[@TheoreticallyMedia]

Haha, someone was saying that he has "Claws"-- but technically, I feel like that's just the fingers part. Hands, I guess? I don't know-- I didn't expect to go this deep on Godzilla anatomy! Still dying to see Minus One!

[@jeffscott3186]

@@TheoreticallyMedia You never know what's going to trigger a deep dive on KZbin. The hand vs paw discussion has raged for a very long time. In the broadest terms- a hand can grasp, a paw cannot. Simple right? No. You have the hand is singular, so if a creature has to use two to grasp then it's a paw, crowd. The no thumb- not a hand group, Oh, it's padded, not a hand faction, and all sorts of variations. If you really ever want to create chaos, go to a symposium of wildlife biologists ask for their opinion on hands. You'll have a riot on your hands (or paws, perhaps). Personally, I think it's primate bias. People are happy saying Opossum's and Raccoons have paws. But, members of the primate family that use their hand/paw in the same fashion have hands.

[@TheBlessingReport]

Thanks for being so fast The morphing gets me too angry Leonardo ai and stability ai are still better with motion from image prompts

[@TheoreticallyMedia]

Oh for sure-- I actually need to do a Leo Deep Dive really soon. SO much has changed over there, and I feel like folks really need to know how amazing it is! So much to do!!

[@universe6735]

Man yesterday i cancelled my runwayml subscription and today we have the new brush. Anyways i dont understand why they dont use controlnet with pose. Thats the best currently to get realistic motion

[@The-Spondy-School]

Have you worked with a GPT called Image Generator yet? Wow -- it's like having a chat with Bard and discussing every little nuance you want in a pic -- then it generates the image exactly as you agreed. I had Image Generator spit out 8 pics for me yesterday in about 15 minutes, and none of them needed "fixing". That's NEVER happened to me before!

[@NamastayGangstaArt]

Sound cool. CN you share a link

[@Strawberry_ZA]

chapters incorrectly refer to invideo ai as Nvidia AI

[@TheoreticallyMedia]

Ah-- haha, can you tell I used a bot for those chapters? Haha-- Thank you, will update!

[@Strawberry_ZA]

@@TheoreticallyMedia thank you for all you do! Chapter keywords are important for SEO, I hope it helps

[@TheeRebel]

3:20 😂 😂😂

[@TheoreticallyMedia]

Love Scandalous Godzilla!

[@jacques42]

More DOMO please.

[@TheoreticallyMedia]

Noted! On the list it goes!

[@captainskrips]

Godzilla has a claw

[@TheoreticallyMedia]

Thank you! I don't know why I blanked on that-- but...also, Paw is hilarious, so I might just keep saying Paw!

[@rocketburnz2297]

runway is painful, it's like those carnival games where only one out of 30 balls actually get in the hoop and it takes a long time.

[@TheoreticallyMedia]

Not gonna lie, it takes a lot. It's getting better every day, but our current state can be a bit rough. I think we'll see something like "Video Referencing" at some point, where you can take a short clip of video and tell the model: "I want this action"-- and via something like ControlNet and Depth Segmentation, it'll know what you're looking for, but that might be a year or so off. Maybe sooner? AI Time does move pretty fast!

[@MetaPuppet]

Great video Tim. That deblur tool is immediately going in my editing workflow. And if you want to know why Rose really didn’t let Jack on the door check my page, I just did an AI video about it ✌️

[@TheoreticallyMedia]

Oh, I'll check that out for sure! Haha, and man-- that deblur tool would have saved my bacon a few times over the years! Can't wait to see it integrated into NLEs!

[@BassmeantProductions]

Domo deep dive please

[@TheoreticallyMedia]

Check!

[@Rockyzach88]

Emojis will never be the same

[@AG_before]

Fantastic video! 👍 The AI Foley assistant looks like such a productive, efficient, and creative solution. Runway = 🤯 What was it - 'Godzilla likes round'? 🤣🤣 Always a pleasure watching your videos Tim. Keep those endorsements coming. We don't mind. We're happy! 💯

[@TheoreticallyMedia]

Dude, that AI Foley-- well, it's kind of like the the thing I did on AI Hands (kzbin.info/www/bejne/op-cc414aNx3q9k), its such a small thing, and by no means "flashy" headline in the onslaught of AI News, but-- I mean, it is the pebble ripple in the water. At some point we'll open Adobe Premiere and have an option to Gen-Fill SFX for our videos-- and this is where it starts! Thanks much on the sponsored comment too! I think I'll have to do a few of them to keep the channel's profit margin-- namely so I can hire someone to take a bit of the load off-- but, I'm always going to strive to keep the sponsors either relevant or helpful to you all. Like, no hyper insane energy drinks or anything!

[@SteelyEyedH]

Most definitely British :)

[@TheoreticallyMedia]

Ta! (I learned that from Gary Oldman in Slow Horses!

[@LouisGedo]

👋

[@TheoreticallyMedia]

The video has been graced by the lucky yellow hand!!

[@00shame]

First!

[@TheoreticallyMedia]

The Chicken Dinner Award is in the mail!! (I wouldn't eat it though!)

[@jacques42]

A claw.

[@TheoreticallyMedia]

CLAW! Yes...haha, I don't know why I blanked on that! But-- Paw? I mean, c'mon, that's funny.

[@daylight3d]

Claw

[@TheoreticallyMedia]

Claw. Thank you! Wait, is the claw just the hand part? Or does that extend to his stubby arms to? I mean, yeah, I could ask ChatGPT, bur comments are more fun. Also fun: Saying Godzilla has a Paw.

[@daylight3d]

@@TheoreticallyMedia I think you could get away with calling it claws. But it’s perhaps best to call it a paw, because thats where the claws are attached.

[@powerthroughfocus]

Yo anyone actually making vids and making money off homies suggestions should post the links here in comments if that allowed?

[@TheoreticallyMedia]

I mean sure-- as long as it isn't anything scammy. I'd say to link YT vids only, otherwise the algo will bury your comment. Algo hates external links.

[@issac7787]

.

[@TheoreticallyMedia]

#?!

[@Mooooty]

DOMO is a NO NO!

[@TheoreticallyMedia]

Why's so? Don't like it?

[@MetaPuppet]

Yeah, curious for some context on why