Sora: Is OpenAI too late for the text-to-video game?

What do we know so far about OpenAI's Sora? It potentially should be the most advanced text-to-video generator, and yet we haven't seen it yet. In this video, I collected everything I could find about Sora, how it works, video samples, and it's future. I have making videos about tools that we cannot access yet, but I guess we'll just have to wait and see.
References:
OpenAI Sora Site: bit.ly/4boiu5Z
OpenAI Sora Video: • Introducing Sora - Ope...
OpenAI Sora First Impressions: bit.ly/3V9w07B
Washington Post: bit.ly/3QTtpfJ
Research:
Explaining Sora's Spacetime Patches: bit.ly/3QSHSbH
Sora Technical Overview: bit.ly/3V6RYZ1
Other Videos:
Shy Kids - Air head: • air head · Made by shy...
"Deflated" Behind the Scenes: • "Deflated" Behind the ...
Beyond our Reliaty: • Beyond Our Reality · M...
My OpenAI GPT-4o explainer: • What OpenAI DIDN'T tel...

[@SpacePonder]

Great video. Sora will be good for surreal videos. I'm interested to use it for cool space videos. It would be cool if we could train it using specific footage. Id like to train it using real nasa footage as ive noticed ai video footage of space is really bad. Also i found it interesting how the spacetime thingy resembles the block universe model.

[@hml]

That's an interesting idea! I doubt that OpenAI will allows us to train on custom footage, maybe only to fine tune it? But with DALL-E, we still cannot train it... However, I'm sure other projects (SVD?), will allows us to do that shortly, the same way Stable Diffusion can be trained on basically anything for image generation. We're starting to see more and more open models for video generation. About the block universe model - that's a fascinating thought! It really does!

[@SpacePonder]

@@hml Agree. Many thanks for your reply.

[@Steger13]

So when are we going to use Sora?

[@hml]

It's a good question, I guess closer to the end of the year. But in the meanwhile the competition is heating up, with Stable Video Diffusion being already here and open source, AnimateDiff, Google's Veo and China's Vidu all breathing down OpenAI's neck, it's just a matter of who releases it first...

[@VulgarTruth]

Is this video dubbed? It's not his voice is it? Hah

[@hml]

lol, I know your nickname is "VulgarTruth", but what is wrong with my voice? 😂

[@sw3925]

@@hml the sound is out of sync.

[@SpacePonder]

​@@hmlno just out of sync

[@hml]

oh, that makes sense... was the first time I recorded a video at 30fps instead of 24fps, and I ruined the sync in a few places, it was resynced manually, and I guess I missed a few spots. Should be fine going forward.

[@animtonni]

Use AI and get left behind...

[@hml]

Why would you get left behind if you use AI?

[@animtonni]

@@hml shortcuts... in any sort of quality production there are none. Jump of the hype train, buckle down and focus on the skill you wanna have... and then start training

[@hml]

Using AI tools is a skill in itself. Yes, it can do pretty crazy stuff even when not prompted properly, but just think about a 3D rendering software that can generate an amazing image with just the default "cube", that you (probably) couldn't draw by hand... by from that cube to Toy Story or Avatar, there's still a very long way to go. Same thing with AI - I've spent the last 5 months learning how to generate AI images with Stable Diffusion, and I'm still far from an expect, and that's after I have almost 20 years experience with Photoshop, and know Blender since version 0.9. If it were up to me, I wouldn't call it "Artificial Intelligence", but rather 'Augmented Intelligence".

[@aestheticPhantasm]

@@animtonni Apparently you do not understand how widespread AI already is and where it is headed. It's literally where the near future meets reality. This is completely separate from the fact that the premise of your statement is flawed: Learning one tool, or even adding one tool to your overall arsenal of knowledge is additive, not debilitating. Art is about play, creativity, and just one way of many quick ways to prototype ideas in a playful and easy way. You wouldn't apply your initial logic too the microwave: worshiping the concept of only cooking with a skillet and urging everyone else to abstain from using microwaves because they are too easy. Where do you nutcases come from . . .

[@aestheticPhantasm]

@@animtonni Apparently you do not understand how widespread AI already is and where it is headed. It's literally where the near future meets reality. This is completely separate from the fact that the premise of your statement is flawed: Learning one tool, or even adding one tool to your overall arsenal of knowledge is additive, not debilitating. Art is about play, creativity, and just one way of many quick ways to prototype ideas in a playful and easy way. You wouldn't apply your initial logic too the microwave: worshiping the concept of only cooking with a skillet and urging everyone else to abstain from using microwaves because they are too easy. Where do you nutcases come from . . .