#90 AutoTracing using Google Colab AutoTracer for MMD

[@xinyuzhu4448]

One idea that might help: You don’t have to track every pose, track only those key pose at key frames. For example, if the hand move from A to B while not changing its momentum, then you don’t need to track every hand pose in between. That is a trick to make the resulting motion looks more smooth and less noisy. But the difficulty is how to identify those key pose in the video. Manually or use some algorithms might work

[@ssvisualisers-tech]

Yes .. I did think of that for some part of the motion to remove those "in between" peak key frames to smooth them too. But this can be very time consuming but doable by "visual" identify on "peak" (graphically speaking using the Blender graph editor) .. for serious smooth motion. Also there are addon that can auto smooth between 2 peaks you select in the graph editor too .. may be better to avoid delete key frames accidentally.

[@FuchsiaRosa]

This is why I would never dance at parties. I’ll be looking like the blue hair girl model 😭

[@itsbyrenji]

Is there a tutorial of how to use the Google Colab AutoTrace?

[@ssvisualisers-tech]

Hmm .. I had been planning to make one but has been push back due to other commitments. Give me another month before I come back to this ..

[@SSVisualisers]

@Ohame I have created a tutorial how to use Google Colab Autotrace. Sorry for the belated respond. kzbin.info/www/bejne/opDLZ6OXgal3kNE

[@qimam7066]

​@@ssvisualisers-tech can you make one now? I've been looking forward to this

[@SSVisualisers]

@@qimam7066 The link to the tutorial .. kzbin.info/www/bejne/opDLZ6OXgal3kNE

[@ssvisualisers-tech]

@@qimam7066 you can refer to this tutorial kzbin.info/www/bejne/opDLZ6OXgal3kNE please support me by subscribing to my main channel music video with one latest mv here kzbin.info/www/bejne/jYbEg4iEZbeFrpY

[@聖護院可憐]

クラウド版MMDautomaticVer2,0じゃん‼️ コレ何度も使ったよ🎵q(^-^q) Miu氏の傑作だよね。

[@SSVisualisers]

Thanks for your feedback. Indeed I am also using ver2 now as shown in my this demo video below on the results. It is pretty good .. but need some smoothing which I uses techniques I am familiar in Blender. kzbin.info/www/bejne/opDLZ6OXgal3kNE

[@acadvideoart]

I tried to do motion tracking in the cloud several times-but every time I finish, I don't have a motion file, but only a video with bones, write a guide if you know what the problem is?? Thank you in advance!

[@ssvisualisers-tech]

Hi Aleksandr, Saw your same comments in the other "smoothing Colab" video. Your outputs should include *.mp4 files (optional based on your choice) .. -- I normally select those that include "boxes" around the "object that moves" (filenames are "ordered_bbox.mp4" and "bbox.mp4") for checking. The final output file name should looks something like *.vmd (your MMD motion file) Expect Feb/Mar next year for a tutorial/guide from me.

[@acadvideoart]

@@ssvisualisers-tech In general, I spent two days on a motion tracker-and in the end I got short fragments of vmd files-which are generally difficult to call movement??I have test variants from two versions of the programs-in the first there is no movement at all and in the second there are some pieces of movements that fly on all planes-maybe I did something wrong?? I can give you a link to Google drive, look at everything in the video folders and all the files there, can you tell me something??Thank you in advance!

[@ssvisualisers-tech]

@@acadvideoart If you come back to me around end Jan 2022.. I will refocus on this tool and see if I can come out with a step by step guide / voice over. I am now committed to other work areas. My apology in advance.

[@acadvideoart]

@@ssvisualisers-tech ok, thanks & good luck 👍✋

[@SSVisualisers]

@@acadvideoart Hi there, I have now created a tutorial on how to run "Colab MMD Auto tracer. Take note how you check the "system files" in this tutorial to validate if the motion file (.vmd) in the output folder is created. Just in case you still have the issue of no motion file in your Google drive folder "autotrace". #112 tutorial with link kzbin.info/www/bejne/opDLZ6OXgal3kNE

[@artofduality5046]

So this won’t work with a iMac?

[@ssvisualisers-tech]

Sorry belated. This is a google colab tool. Just need a google account and it runs on the web for free. Having said that, there exist other options .. such as AI tool to perform video2video tracing with different characters of a choice. Example in this link video2video tracing results I did with AI tool (Stable Diffusion with Deforum extension. You can do more with "masking" and put your characters in different background etc .. kzbin.info/www/bejne/mHXbdmRpgtp-rKc

[@enbu2676]

For test 4, how do you convert bvh to vmd?

[@qimam7066]

tutorial pls

[@SSVisualisers]

Refer to #112 pls kzbin.info/www/bejne/opDLZ6OXgal3kNE

[@Obsidianskin]

does this work for fight scenes?

[@SSVisualisers]

Yes for sure any motion .. but avoid too many characters. For clean and easy smoothing, I suggest 1 person video, or 2 (with minimum turn around and crossing each other .. else more parameter settings in one of step the Colab autotracing program.

[@Obsidianskin]

@@SSVisualisers I wanted to have a short clip of a part of a fight , I tried doing it it don’t work to well , can I pay you to do it ?