Making Viggle Motion Capture Movies

  Рет қаралды 14,215

hyperbolic films

hyperbolic films

Күн бұрын

Пікірлер: 68
@seanmaynard7417
@seanmaynard7417 2 ай бұрын
The acting is the key.
@wholeness
@wholeness 2 ай бұрын
Always, a nice guitar doesn't make good player.
@FrankEBailey
@FrankEBailey 2 ай бұрын
I really need to see General Spade having his face eaten off by one of the creatures, and our main character looking over with an "I told you so" look on his face.
@hyperbolicfilms
@hyperbolicfilms 2 ай бұрын
Yeah, seems like it should be the last enemy Spade faces.
@nitromusik9275
@nitromusik9275 2 ай бұрын
The first one to incorporate this into a streamlined tool together with storyboarding is going to be the king of AAA preproduction and used to level up pitching scripts by a lot
@hyperbolicfilms
@hyperbolicfilms 2 ай бұрын
Yeah, I think it's a nice way to do previz, and if you see my KZbin short where I integrated JetSet's virtual production app into this workflow, there's some big possibilities. But it is too many steps. I think it can already be a single workflow in ComfyUI (there's a Mick Mumpitz KZbin video that has relighting and background swaps, the only necessary addition would be Animate Anyone Evolved as a replacement for Viggle).
@TheJan
@TheJan 19 күн бұрын
insane thanks!
@TPCDAZ
@TPCDAZ 2 ай бұрын
This is really great work man
@hyperbolicfilms
@hyperbolicfilms 2 ай бұрын
Thanks!
@Broadydudester
@Broadydudester 2 ай бұрын
Gonna be my next music video
@jacekb4057
@jacekb4057 2 ай бұрын
This is freaking amazing!!!
@Mrim86
@Mrim86 2 ай бұрын
Love the lower third
@gabeaiartist
@gabeaiartist Ай бұрын
Wow, amazing film!
@danielschweig3177
@danielschweig3177 2 ай бұрын
I really like the workflow. Have you tried further editing the finished scene with Runway vid2vid? Maybe there is a way to create consistent runway vid2vid. It should actually work.
@hyperbolicfilms
@hyperbolicfilms 2 ай бұрын
I don’t think there’s a way to be consistent, but I’ll give it a try. I suppose it might work using the same prompt and a seed. As I was finishing this, I started playing with FaceFusion 3.0, and the results were very very good. Doing one more test and then I’ll put a video together about that fix. I think it removes the Krea step, and it can be run locally, so it’s free.
@danielschweig3177
@danielschweig3177 2 ай бұрын
@@hyperbolicfilms As far as “motion capture” is concerned, I know of 3 other AI platforms that have it: - Chromox -Domoai -GoEnhance I test the platforms myself and see who delivers the better result.
@danielschweig3177
@danielschweig3177 2 ай бұрын
sorry for the spamming, haha, but there is also the website software called “Wonder dynamics”. Do you know her? The results are a lot better than AI motion capture. The results can also be downloaded as an MP4 file.
@hyperbolicfilms
@hyperbolicfilms 2 ай бұрын
@@danielschweig3177 Yes, Wonder Dynamics seems very good, but the limited amount of time you are given (2.5 minutes in the $16 plan, 10 minutes in the $84 plan) has kept me from using it.
@hyperbolicfilms
@hyperbolicfilms 2 ай бұрын
@@danielschweig3177 Sorry, I thought I responded to this. I have tried it and it’s very good but they don’t have many character options to work with. I keep waiting to find a project to use it on.
@FilmSpook
@FilmSpook 2 ай бұрын
Very cool, thanks Bro! Just subscribed. Cheers
@hyperbolicfilms
@hyperbolicfilms 2 ай бұрын
Thanks for the sub!
@markdkberry
@markdkberry 2 ай бұрын
this is great. eager for AI open source movie making. I'm guessing 1.5 hour vids arent possible yet.
@hyperbolicfilms
@hyperbolicfilms 2 ай бұрын
@@markdkberry The rendering would take a while. I’m sure as the models get more efficient and video cards get better, we’ll start to approach realtime with all this, but I think that’s still a few years away.
@bhsmith5496
@bhsmith5496 2 ай бұрын
What do you do about the generated image taking on the physical characteristics of the human model. I like Viggle but I have noticed that the image will take on the facial characteristics of the human model.
@hyperbolicfilms
@hyperbolicfilms 2 ай бұрын
I'm not sure there's a way around that, as it is taking the expression and posture from the input video. I walk with a bit of a hunch, and I noticed that it transferred over in some characters. Also a broader person will result in a broader character, at least sometimes.
@bhsmith5496
@bhsmith5496 2 ай бұрын
@@hyperbolicfilms Thank you!
@Young_Zealous
@Young_Zealous 2 ай бұрын
Yeah I’m getting this
@brawlmaster7
@brawlmaster7 2 ай бұрын
very cool!! :D excellent tutorial too! hahah, great work!
@hyperbolicfilms
@hyperbolicfilms 2 ай бұрын
Thanks a lot!
@tunbimideoluyede8464
@tunbimideoluyede8464 14 күн бұрын
Hey this video is amazing, I was just wondering what prompt you used to get the specific style of character you got?
@hyperbolicfilms
@hyperbolicfilms 14 күн бұрын
Thanks! The Midjourney prompt was "Photorealistic, full body, latino soldier with stubble in dirty t-shirt and black pants, 40 years old, white background, f4, 35mm" He ended up looking more concept art style than photorealistic. I later ran the image through Krea to get it to be more realistic looking, but that was in a video after this.
@EllisJonesDeath
@EllisJonesDeath Ай бұрын
What site did you use for your character, I have tried Kling and Bing but it always creates characters with shadows on the face, I have tried prompting no shadows etc, but it always adds them.
@hyperbolicfilms
@hyperbolicfilms Ай бұрын
It's hard to not get shadows. You can try asking for even lighting, flat lighting, or diffused lighting and see if that works.
@LeonGustin
@LeonGustin 2 ай бұрын
Have you had the chance to check out Runway Gen3 video-to-video yet? Be cool to get ayour thoughts on it.
@hyperbolicfilms
@hyperbolicfilms 2 ай бұрын
I like it a lot, but in my tests I couldn't get a second clip to match the first clip, even with the same prompt and seed. The background would change, and so would details on the character. So while it's good for short shots and definitely easier than this method, it's not as consistent across multiple shots.
@sundayreview8152
@sundayreview8152 2 ай бұрын
can you do a review of runway 3 video to video?
@hyperbolicfilms
@hyperbolicfilms 2 ай бұрын
@@sundayreview8152 I may make a short film with it this weekend, if my camera man doesn’t have Covid
@knicement
@knicement Ай бұрын
How did you slice the 2 minutes into 10 seconds each?
@hyperbolicfilms
@hyperbolicfilms Ай бұрын
In my editing app (Davinci Resolve), I rendered out 10 seconds of the performance at a time. It's very slow and tedious.
@hyperbolicfilms
@hyperbolicfilms Ай бұрын
In Resolve, you can also set the Output to Individual Clips, and then break up your video into 10 second fragments. That works well.
@knicement
@knicement 20 күн бұрын
​@@hyperbolicfilmsthank you
@marcusmanningtv
@marcusmanningtv 2 ай бұрын
Awesome
@Herve_art
@Herve_art 5 күн бұрын
Crazy
@FSK2
@FSK2 2 ай бұрын
You can do it runway ml also
@hyperbolicfilms
@hyperbolicfilms 2 ай бұрын
@@FSK2 Video to video in Runway is not repeatable. Even with the same seed between shots, it will change a lot of the details. I hope they get there eventually, but it still has that limit now.
@wrillywonka1320
@wrillywonka1320 2 ай бұрын
Can you use a 3d mesh in place of the 2d image?
@hyperbolicfilms
@hyperbolicfilms 2 ай бұрын
Yeah, should work. This week I plan to test using a 3D environment and using a motion captured 3D character to do the action scenes for the same character that a human plays in live action.
@DrHansBrewery
@DrHansBrewery 2 ай бұрын
Cool
@gintokigojo
@gintokigojo 3 күн бұрын
Wow
@gwart41
@gwart41 2 ай бұрын
What program did you use to alter the voices?
@hyperbolicfilms
@hyperbolicfilms 2 ай бұрын
@@gwart41 Eleven Labs. They seem to have broadened which voices can be used for voice to voice in the past few weeks.
@markdkberry
@markdkberry 2 ай бұрын
look at RVC
@IkeWaghSF
@IkeWaghSF 2 ай бұрын
I'm definitely on the Viggle train! I made this a few months back using Viggle for live performances. I tried my best to include it within a coherent story (character, violence, action, plot, etc.). Viggle wrote a blog about it. Hope you like it: kzbin.info/www/bejne/mqDQoZKdZ7KUr8k
@hyperbolicfilms
@hyperbolicfilms 2 ай бұрын
Incredible work! That is easily one of the best films made with AI that I've seen. Are you working on part 3? Really inspiring.
@IkeWaghSF
@IkeWaghSF 2 ай бұрын
@@hyperbolicfilms Thanks! I typically can only make one big project every few months. I definitely have a draft script, but I'm working on my storytelling skills a bit before jumping into the lab. But it'll definitely be a project for early 2025! Glad you enjoyed it
@kleber1983
@kleber1983 2 ай бұрын
Is wiggle free? Or is there a open source alternative?
@hyperbolicfilms
@hyperbolicfilms 2 ай бұрын
As far as I know, Animate Anyone is similar, but I don’t think it’s as advanced. There may be another one for Comfy with Motion in the title, but I don’t remember its exact name.
@pdwhalen
@pdwhalen 2 ай бұрын
Up your gain going forward please😊
@giuliomarunti2093
@giuliomarunti2093 2 ай бұрын
It all looks like shit... But considering the ease and time necessary to do everything it's pretty impressive!
@FilmSpook
@FilmSpook 2 ай бұрын
Typical comment from someone depressed who has nothing on their channel. Get your eyes checked, son. *It looks excellent.* You are unrealistically hoping for Hollywood level production here, and that's not happening at this point. The result that he created looks very clean. You have no creative content on your channel, and nothing good to offer.
@FilmSpook
@FilmSpook 2 ай бұрын
Says the Karen with nothing on her channel. 😂 The result that our bro created looks very good and clean. Where is YOUR original content on your channel?? That's what I thought, hehe...
@izzmotion9917
@izzmotion9917 2 ай бұрын
If you know how hard to motion capture or animation, you would never comment anything like this. This video isn't for people like you, don't be a cyber bully
@giuliomarunti2093
@giuliomarunti2093 2 ай бұрын
@izzmotion9917 ok guys, I wasn't cyber bullying nobody... My comment was just an exaggerated way to say that this ai model is still unripe, and impressing yet. Wasn't criticizing the work of the KZbinr in any way... but I think he understood what I meant, considering he liked the comment.
@realhamza2001
@realhamza2001 2 ай бұрын
I know this is unrelated but give the Quran a read
@zherusalemvideos
@zherusalemvideos Ай бұрын
Hi there! Just shot you an email, but in case you missed it - I lead Partnerships at Viggle, and we would love to connect and chat!
10 AI Animation Tools You Won’t Believe are Free
16:02
Futurepedia
Рет қаралды 571 М.
小丑女COCO的审判。#天使 #小丑 #超人不会飞
00:53
超人不会飞
Рет қаралды 16 МЛН
How to  make thumbnail for YouTube|| best app for YouTube thumbnail
0:51
UK Tech and reviews
Рет қаралды 844
AI Learns to Play Tag (and breaks the game)
10:29
AI Warehouse
Рет қаралды 4,9 МЛН
Unreal Engine-Aximmetry Virtual Production Studio Tour
20:14
EIS Metaverse
Рет қаралды 2,2 М.
How I made this battle scene in blender
11:05
FxForge
Рет қаралды 895 М.
INCREDIBLE: AI Storyboard Tool - Katalist Review Workshop
21:10
Haydn Rushworth
Рет қаралды 35 М.
6 Years of Blender in 13 Minutes
13:01
Kaizen
Рет қаралды 422 М.
Runway Act One- testing performance capture with the crazy new magic
7:10
Adding action Viggle cartoons with motion capture data!
17:21
hyperbolic films
Рет қаралды 288