Thank you for watching!

Thanks!

@@SpaceGhostNZ Thanks! I wish I’d done something more classic weird Star Trek, but now that I have the assets I may try to do another episode that goes into giant hand holding a ship territory.

That's fair, but in the past 3 months since I posted this, it's come much further along. Characters are much more realistic and I've incorporated moving cameras, so the filming experience can be much closer to traditional filmmaking, just with an AI layer over it. I see the evolution of this letting a small group of actors play dozens of characters in whatever setting they want. I also think this style of AI generated stuff at least incorporates the performance of an actor. So many of the AI video bros are desperate to move to the point where they press a button and get a shitty TV show. I am looking for ways to make sure humans remain a key part of the process.

@@hyperbolicfilms I could see how this would be good to try out an idea, but I'd never trust it for a final. If anything it is probably good reference for a VFX artist to take it the rest of the way. Glad to hear you aren't on the AI bro train, but personally I remain extremely skeptical. Traditional 3D tools are so accessible and so good now that AI honestly has steep competition. Have you tried metahumans and Unreal yet?

@@LFPAnimations Professionally, I am using AI stuff for previz. Essentially when clients need to show what the final project can look like, it's a better communication tool than just a storyboard or a moodboard. And that's where I think all of this tech is best at, I have used Metahumans quite a bit, even live on an LED wall as a background character, but I'm more of an iClone guy. More flexibility even if the characters aren't as realistic. I'm in the midst of a big iClone project now, and nothing can beat animation for real control of what the characters are doing.

No, I just have an old license and can't justify the upgrade price. I don't think you can get the previous versions.

Kling is very overpronounced with its lipsync generally. It's good for people speaking loud. Runway is better for people speaking quietly.

Yes, just working with it right now. Much better on characters with realistic shading, but not getting great results at the moment with anime style characters.

Thanks! The Midjourney prompt was "Photorealistic, full body, latino soldier with stubble in dirty t-shirt and black pants, 40 years old, white background, f4, 35mm" He ended up looking more concept art style than photorealistic. I later ran the image through Krea to get it to be more realistic looking, but that was in a video after this.

A Whovian with enough disposable income could rebuild so many lost episodes from Doctor Who!

Yeah, definitely has that rotoscoped feel!

Glad you enjoyed it

It's hard to not get shadows. You can try asking for even lighting, flat lighting, or diffused lighting and see if that works.

This started as Midjourney images that I animated with Viggle, and then used Krea to clean up the video quality.

1. In theory. I think they slow you down after a certain number of credits. 2. You have to upload a video of someone acting. It's essentially like a motion capture for the face/head. 3. I don't think Runway has any translation functions. 4. If you want to take a photo and an audio clip and make a talking head, there are other tools that do that. Kling does it indirectly. Hedra is probably the easiest way to do this.

ElevenLabs voice to voice

In my editing app (Davinci Resolve), I rendered out 10 seconds of the performance at a time. It's very slow and tedious.

In Resolve, you can also set the Output to Individual Clips, and then break up your video into 10 second fragments. That works well.

​@@hyperbolicfilmsthank you

@@Mrim86 Thanks! I’m trying to think up ways to break the dialogue shots up as well, so there can be some change in pose to fit the dialogue. Might not be feasible with Act One as it is

These backgrounds were generated in Midjourney itself, along with the character.

Hedra uses audio to automatically animate a photograph, but you don't get control over how it moves the face. Live Portrait is similar, but the results of Act One are much better. With Live Portrait, some face movements add jitter to the face. Act One also seems to work well on stylized faces, which I don't think is the case for Live Portrait. At least I can't remember seeing any results of stop-motion style characters.

@@hyperbolicfilms Cheers for the reply, be interesting to see the coming updates from Viggle, Hedra and poss Live Portrait - lots of compation with AI tools now :D