Google's AI Video Generator Beat Runway in Side-by-Side Test!

[@KittyBoom360]

Just a kindly inserted FYI, when you were talking about transcripts, you really meant captions, and there is a meaningful distinction between the two. Transcripts are for audio-only files without syncing to the original file. Captions are for files that are then synced with the video. I know this well because one of my gig jobs is captioning, and our platform also has a separate job list for transcripts. Basically, think of transcripts as like a court room audio being transcribed for others to read or for someone talking into an audio recorder who wants to read their audio, while captions are something you'd read along with a video file where the two are in sync as you watch. Like on KZbin, you're reading captions, not transcripts. Hope that helps going forward!

[@AllanGildea]

Thanks for the typically excellent and comprehensive round up of AI mayhem. Moving so fast!

[@TheJereld]

Congrats on the 100K subs and this channel is one of my fav AI news sources!!!

[@curiousrefuge]

Yay! Thank you!

[@TheoreticallyMedia]

Happy Birthday, Caleb!!! Extra slice of cake for you!!

[@curiousrefuge]

Haha thank you friend!

[@TradeRealm]

Last time I was this early we were generating paragraphs with prompts... Damn its moving too fast.

[@davidjohnsen3425]

Congratulations on reaching 100K subs, and happy birthday, Caleb!

[@curiousrefuge]

Yay! Thank you so much. :)

[@agnesslovehealz]

Happy birthday cheers to a new beginning with many blessings ahead thanks for all ur videos derivation and spreading the love

[@ydvisual5530]

I am a Runway ML pro user - but I didn't even know about the text to audio - haha ; thanks for the update!

[@curiousrefuge]

Our pleasure! Thanks for watching!

[@GroRoomHomeStudio-hi8je]

It is so intense learning, and really amazing, ofc one generator-site cant make full animated video by just one quick prompt script, i may have expected waaay to much of AI, but Yeah it goes mentally fast so thnx for keeping us noobs updated to get insights 🙏🙏🙏

[@growtribes]

I’m executive producer at AI Film Agency. We’re working on that, but the low hanging fruit for us is raw story boards, and from there we’ll advance into full pre-script development with AI, then the humans join into refining the real business of making real movies with AI assistance begins. Our motto is: Enhance, never Replace.

[@thisisreallychris]

Just popping in to say this is my favourite new channel I have found in 2023. Thank you so, so much for these and all the effort that goes into them. This is my one stop shop for Video AI news and I am obsessed. The formatting is amazing, concice and entertaining. The chapters help so much in navigating to the tools that apply to my current interests and provide such good insight. Mad blessings for the new year! You guys are awesome! 🖤🖤🖤

[@thisisreallychris]

Also - I'm coming for that jersey...

[@curiousrefuge]

Wow, thank you! We're so happy you enjoy the channel and thank you so much for tuning in to our content! :)

[@starfox300]

AI is gonna supercharge the advancement of technology. I cannot fathom how the world will look in 10 years

[@curiousrefuge]

It will be crazy indeed!

[@david_arthur_brown]

The little man made of "blocks" is in fact Bertie Bassett, the liquorice allsorts man. just FYI. 🙂 The channel is superb, btw. Very inspiring and useful.

[@theyshouldhavenevergivenme5439]

What's really amazing here is how AI it all still looks... They are CLEARLY not there yet despite all the hype. Those horse legs really need to be looked at man ;;)

[@curiousrefuge]

The hype is largely around the potential and speed at which things are improving. It's fascinating to see how fast things are evolving and 2024 is going to be insane :)

[@samariagraham4502]

Track #2 was nice, possibly the real one.

[@GetRealwithMike]

The film industry has always been out of reach for most of us, so it's fantastic that we may be able to do the projects we want without having a million dollar budget and equipment. I've been in film since the 80s but couldn't afford the equipment and processing. Finally, at 64, I see a light at the end of the tunnel. My retirement is going to be exciting. Thanks for your videos.

[@curiousrefuge]

We appreciate the comment and totally agree. These tools, at the heart, empower people to create and especially those that didn't have the means to do so or were gatekept away for various reasons. Thanks for watching and commenting!

[@MALANDRO4EVER]

Happy Bday. Congratulations

[@christopherpoet458]

8:00 - Is it just me or does anyone else feel like the OG audio was just fine? The background noise was easy to ignore and I could hear and focus on the dialogue. The Runway version sounded horrible like it attempted to clean up the surround sound and instead left spikes of it that meddled with the dialogue audio. Maybe I just don't have a trained ear for this but I am failing to see how that was a good example.

[@curiousrefuge]

We'll have to produce some more examples for a more thorough test :)

[@jacobwest7]

Movie studios can still employ vfx artists and filmakers and everyone else and for those of us who could never afford to make a film we can use a.i, everyone's happy

[@curiousrefuge]

Good point!

[@Mrim86]

That Pika waitlist is killing me :(

[@christopherpoet458]

Right?! I am getting impatient and have a tab open on it that I refresh almost daily. Just. Let. Me. Use. It. Damnit. Gerr.

[@octsurp11]

Got in a few days ago, only waited a week. It's great, but still prefer runway for now

[@curiousrefuge]

So sorry! We're not sure why more people haven't been given access yet! But we hope you are on it soon!

[@curiousrefuge]

Both have some interesting use cases!

[@john_blues]

Just saw the Paper on Google's AI video generator. It looks insane. But I've tempered my expectations after the Gemeni debacle though. Can't wait to see it in action, and see the ideas behind it hit open source as well.

[@curiousrefuge]

Yeah we'll see what the final product looks like. I imagine because they've already started with AI backgrounds on KZbin that it will be integrated into the engine running that feature. Google has to be a lot more careful than companies like Runway or Pika so the red tape may prevent them from ever being seriously competitive in that space, but who know?

[@godbodyrock]

Outstanding comparative Sir!

[@curiousrefuge]

Glad you liked it!

[@NickDrinksWater]

Its getting better and better

[@curiousrefuge]

So true, 2024 will be insane!

[@realAIDOPE]

AI video generation is and continues to get more and more DOPE! Thanks Curious Refuge for the head's up and great breakdown. 👊

[@curiousrefuge]

Cheers friend!

[@Holmes-221B]

A última coisa que eu esperava era ver o papai Noel aqui na minha terra, no final deste vídeo sobre A.I. Parabéns ao Antônio Carlos! Foi brilhante!

[@lomotil3370]

🎯 Key Takeaways for quick navigation: 00:00 🎬 *Revolutionizing AI Filmmaking:* - Google introduces groundbreaking AI filmmaking tools, reshaping the future of film production. - New tools like GM Talker enable emotion manipulation in subjects, allowing for nuanced emotional adjustments. 01:48 🤖🎥 *Google's AI Video Model "Walt":* - Google unveils AI video model named "Walt" with impressive text-to-video and image-to-video capabilities. - Demonstrates early-stage realistic results, excelling in visual effects and introducing a unique feature-rotation around subjects. 04:29 🎵🔊 *Runway's New Audio Features:* - Runway introduces new audio features, including text-to-speech, audio cleaning, and sound effects generation. - Users can generate AI-based voices, clean audio in-browser, and create unique sound effects using prompts. 09:32 📜💬 *Runway's Subtitle and Transcript Tools:* - Runway adds subtitle and transcript tools for easy integration of text into videos. - Users can edit transcripts, generate subtitles, and remove silence, streamlining the video editing process. 13:32 🌐🎶 *AI Advances Beyond Film:* - AI developments extend beyond film with innovations in music generation and 3D asset creation. - Google's AI music tool and ChatGPT 4.5 rumors hint at the expanding role of AI in diverse creative fields. 23:41 🔄 *AI video stabilization tool released on GitHub, allowing users to enhance footage quality significantly.* 24:07 🌐 *Researchers developed a technology combining gaussian splats and motion-tracked animation to create semi-photorealistic animated versions of people, raising concerns about the future of background actors in films.* 25:00 🎥 *Google introduces Diffusion Light, a tool that automatically generates reflection maps (Chrome ball) from uploaded reference footage, simplifying the compositing process for 3D elements in scenes.* 26:10 💡 *Advancements in AI-powered diffusion face relighting technology promise to revolutionize scene lighting in video editing, offering more impressive capabilities compared to existing tools.* 27:06 🌐 *Google showcases a technology allowing real-time exploration of gaussian splats, hinting at future applications in creating photorealistic virtual worlds and enhancing storytelling experiences.* Made with HARPA AI

[@curiousrefuge]

Thanks for the AI breakdown :)

[@ppowell1212]

As always great content.

[@pennyandluckpokerclub]

Wow! 🤩 100K!!! Congrats 😃

[@curiousrefuge]

Thanks! 😃

[@Artyficial.Intelligens]

The two song clips sound like generated by AI. But if really only one was AI, it was the first one. The second clip sounds more real.

[@curiousrefuge]

Interesting guess :)

[@BoozyBros]

Happy late birthday and Congratulations on your play button!!! 😁😁

[@curiousrefuge]

Thank you so much friend :)

[@robotheism]

thanks for uploading great content!! ❤️

[@curiousrefuge]

Our pleasure! Thanks for watching!

[@mindjourneyai]

v 6.0 is already out. You just missed it man!

[@curiousrefuge]

Haha that’s the world of AI for ya. 2 hours later and everything changes :)

[@PlacerFilosófico]

congrats and thansk for the info

[@drnabs872]

Not surprised, I’ve been using runway since the released gen-1 but honestly for now it’s overrated thanks for the share

[@HaydnRushworth-Filmmaker]

Excellent research and summary, guys. Thanks very much, you've become an absolute must-watch! :-)

[@curiousrefuge]

Our pleasure! Thanks so much for watching!

[@optimoos]

superb. I'd like to participate in the next competition please. when would it be? thanks

[@curiousrefuge]

We'd love for you to participate! We will announce the next one shortly after the new year :)

[@Abenimae]

happy birth day! and congratulations

[@curiousrefuge]

Thank you so much 😀

[@Gta_Selection]

5 more years it will be crazy

[@curiousrefuge]

Even by the end of 2024 will be crazy!

[@demonhogo]

i wonder how soon these will get good enough to use besides just comparison tests

[@curiousrefuge]

I'm sure by the end of 2024 it'll all start to get real difficult to tell among all the tools so we'll see fewer tests!

[@zackdemundo]

Congrats!!

[@curiousrefuge]

Thanks so much!

[@digitalxtremetelevision7724]

So you're saying there is no character voice animation in Runway? The characters can't speak? Only a voice over can be heard using text to speech? That's good to know because I was just about to pay $28.00 to join Runway.

[@curiousrefuge]

True, you'd have to use other tools like D-ID, Lalamu, or Wav2lip for the lip syncing

[@officialstylechild]

Number 1 was generated song

[@john_blues]

The bluejay turns into a pigeon. 😁

[@curiousrefuge]

:)

[@Skettalee]

First Beat is real and second one was an ai creation.

[@cinematic_monkey]

Exactly the opposite.

[@curiousrefuge]

We'll seeee!

[@Skettalee]

what do you mean we will see, when that information is a fact, right? @@curiousrefuge

[@Ree1981]

This tech is so unrefined. I hear 3D movie companies are hiring people to 'edit hands' instead of animators, which is such a bad move at this point.

[@curiousrefuge]

Good to know! It's true - there are specific use cases in which these tools excel at the moment and it's not great for everything ...yet!

[@THarveyComedien]

People tend to underestimate how incredible this is even at a pre-alpha state. Knowing that the tech is upgrading exponentially should be worrisome for the entertainment industry. I am not a fan of AI but I think this will become an incredibly powerful tool that could shake the foundations or entertainment giants

[@Ree1981]

@@THarveyComedien Nobody cares what anyone thinks unless there are arguments. Also, civilization is doomed due to climate change, so.... shut up.

[@shrihas62]

Thinking about creating realistic ai movie, which software do you recommend? Runway or Pika or something else.

[@curiousrefuge]

We'd recommend starting with some kind of image generation tool like Midjourney and then using either Runway or Pika (it depends on your style)

[@growtribes]

#1 is AI.

[@MALANDRO4EVER]

1 is real

[@user-Hm-pt]

❤love it

[@octsurp11]

Will always choose others over having to use Google

[@curiousrefuge]

Fair enough!

[@zellionnn3310]

When does walt come out ?

[@curiousrefuge]

Huh?

[@nicholastoo858]

If anyone should have the best, it has to be google, because they have KZbin videos for training.

[@curiousrefuge]

Interesting point - we'll see how that plays out later this year!

[@mikes5079]

I'm trying to make a music video with tasteful "implied nudity" (will pass on YT), and trying to storyboard it on AI and keep running into errors saying it can't generate the images or sketches due to content violation. I certainly understand the deterrent from allowing people using AI to create porn, but is there a prompt, or AI model that will allow for implied nude? thanks!

[@curiousrefuge]

Due to the sensitive nature of AI , many of these tools have fairly strict prompt rules right now. I'm afraid we don't have any alternative sources to share that can get around these measures.

[@mikes5079]

@@curiousrefuge Thanks for the response. Happy New Year!

[@lonewitness]

Why even give the big tech any coverage at all?

[@aaagaming2023]

Its about what can create the highest quality since its about film making.

[@curiousrefuge]

We try to be agnostic about everything so everyone gets all the information from every source.

[@waterworka1]

These tools seem cool, but they are not solving any problems... Video editing and graphics solutions... Huh?

[@curiousrefuge]

Agree to disagree :). These tools certainly do solve some problems - for example - better rotorscoping - faster asset generation - faster editing (ie. inpainting or video inpainting) - And now we are getting into text to 3d assets and 2d to 3d asset generation

[@waterworka1]

@curiousrefuge I see where you are coming from, but when i worked as a designer, I never had a problem doing those thing's...its cool to have a faster process, however, it's "the process" itself that I enjoy.

[@Michael_Jeromy_Kaiser]

Sample 2 is ai

[@iamisobe]

metas is better IMO

[@curiousrefuge]

Competition is getting intense!

[@fiftyshadesofgrey1991]

I don`t think they really say so on stage, it sounds weird for emotionally developped people

[@curiousrefuge]

Interesting point

[@assholeyeng]

2024 already weird

[@curiousrefuge]

2024 is going to be insane!

[@Mooooty]

I trust nothing coming out of Google...nothing!

[@curiousrefuge]

Hahaha fair enough!

[@sapito169]

finaly we have emotions in face ai generated videos were ugly af when you take to much time showing the face for that rason

[@curiousrefuge]

More ways to humanize these tools will make the stories all much more engaging. We're here for it!

[@rocketburnz2297]

google 8fps, dead on arrival i

[@curiousrefuge]

True! We need 24fps to start at this point! :)

[@jstubbles]

"AI Skills" lol. This all looks like complete trash. Flickering, phasing, fluttering images and video. All based on stolen image data sets. What a joke. This is zero skill. To paraphrase Malcolm from JP, "I'll tell you what's wrong with this. It didn't take any discipline to obtain it. You didn't earn the talent for yourselves, so you don't take any responsibility for it. You stood on the shoulders of actual talented artists, to accomplish something as fast as you could."

[@octsurp11]

Heard this same fear induced argument when after effects and Photoshop were released. This is the flip phone stage of AI tech, it will advance and become a tool everyone uses

[@jstubbles]

@@octsurp11 AI tools have been used for decades in many facets of development. Used in games, Video Production and more. But they are used as assistants to the human creator, not a replacement. These new tools aim to replace talented artists completely. People who have spent decades honing their craft and skill, to get replaced by a piece of software that has stolen work from them. Do not delude yourself into thinking you are an "artist" by using these new AI tools. You're a glorified secretary. A literal monkey can type in a prompt and get something neat looking. This removes the most important aspects of artwork - talent, heart and soul. All AI does is make copies of a copy of a copy. It has no style of it's own, and thus needs to steal from others. Eventually there will be no true artists left to create real art.

[@curiousrefuge]

We appreciate your passion and of course we strongly disagree as many long time artists adopt these tools and make new things. Very often, the demos of this tech are referencing existing material but the vast majority of AI work creates totally new assets based on a mix of different styles. Much like how artists take influence from other artists as they grow up and eventually come up with their own style.

[@Creighty]

⁠@@jstubblesYep, this is definitely the sad truth about the new tech. Now everyone will be not entirely real artists because it will be too simple and unskilled for doing fantastic arts.

[@haroldvictoriart]

Great!!

[@curiousrefuge]

Thanks for watching!

[@cheneffective1983]

the second clip is from the stock for sure, fat sound and stereo🤘🏻🥸

[@curiousrefuge]

Maybe maybe maybe :)

[@cheneffective1983]

if not, I need this ai tool for sure@@curiousrefuge 😅