Bad Apple!! on OpenUtau feat. Haruka Nana／春歌ナナ

Рет қаралды 144

Күн бұрын

#utau #vocaloid #badapple
If it exists, you can play Bad Apple on it
Credits:
Original: ZUN remixed by Masayoshi Minoshima feat. nomico
Haruka Nana by Nanahira: nanahira.jp/ha...
ustx/tuning/video: Me
Tools:
Vocal: OpenUtau
(Voice: 春歌ナナおしゃまさん連続音
Resampler: doppeltler-moresampler for main, SpaceWorld for hamony)
Drawing: OpenUtau, Python, ffmpeg
Video: OBS
USTX: will be shared someday
Sorry for not uploading a video for more than 2 weeks.
After uploading the igaku cover, I intended to make the next cover, hitomania, but I felt like I lost my motivation to continue because the tuning was very difficult but the video concept was already there. When scrolling through KZbin, of course there were bad apple videos that appeared on the homepage. Then... "I have an idea!".
The method that came to my mind was using ghost notes to draw along with scrolling pages to change frames. I did several experiments first to find the best scroll page by changing the tempo, changing the scroll speed, and even trying to use the cheat engine to change the scroll speed without changing the tempo. What's annoying is that if you choose to change the tempo, in OpenUtau it is limited to only 1000BPM which is not fast enough.
How is Bad Apple run on OpenUtau?
Please note that the OpenUtau save file (.ustx) is very easy to manipulate, so the drawing of notes can be done directly by writing the note code in the save file, moreover the BPM limit can be exceeded just by changing the BPM data.
1. Change the frame rate and resize the original video with ffmpeg (used 128x36, ~9.21 fps adjusted to BPM)
2. Convert video data per pixel to numpy array (join channels with average, then round to 0 or 1), then concatenate frame arrays)
3. Optimize by changing to instruction set (position, tone, duration) if there is a continuous note, then merge it by adding duration.
4. Change the instruction set to note format in ustx. Move to the ustx save file.
How can Haruka Nana still sing following the tempo?
This part is quite tricky because in OpenUtau there is a change tempo preserve timing feature, but the maximum is 1000 BPM, so you have to manually change it in the save file. It turns out that only "position" and "duration" need to be changed, the others are relative values with notes. So it can be easily changed using python regex.
Is the video legit run?
Yes, surprisingly OpenUtau is very fast at changing pages. Maybe it would still runs if the speed was 2x faster. Have to manual scroll slowly to align the screen better.
How long does it take to make?
2 days (with breaks), include ustx, tune, and script.
Audio/mixing quality may be bad because there's no mixing process.