To Become Vocaloid

Video about Hatsune Miku and also a few other things.
Patreon: / junferno
Join the Discord: / discord
Secondary Discord invite if vanity invite expires: / discord
Twitter: / junferno
Check out my other stuff on GitHub: github.com/kevinjycui
Corrections: junferno.com/corrections/#list-1
Footnotes:
- The Kempelen Speaking Machine is another voice synthesizer created by Wolfgang von Kempelen a few years after Kratzenstein, which uses similar elements but is better documented
- Timbre and tone have many different definitions in music/math/psychology but we're using the purely mathematical definition according to H. Kenmochi in "VOCALOID - Commercial singing synthesizer based on sample concatenation"
- The newest versions (V5) of Crypton Future Media's vocaloids such as Hatsune Miku are released on Crypton's own software, Piapro Studio
- Jinriki voicebanks are Utauloids that use samples from popular media (e.g. Bernie Sanders, SpongeBob) without permission from the voice provider. These voicebanks may be used for personal covers but distribution is illegal
- Other types of voicebanks for UTAU include VCCV
- Voicebanks would often record the same sounds in many different pitches to prevent having to shift the pitch of a sound too much
- Synthesizer V Studio or SynthV Studio is a singing synthesis software released in 2020 using a hybrid AI/sample concatenation synthesis engine that has been gaining popularity in recent years
References: pastebin.com/kn1srxAM
Photos courtesy of Wikimedia Commons, Fandom
Tanjiro Taidana: / @tanjirotaidana
Junferno UTAU Voicebank (Junfune CV): www.mediafire.com/file/22pdpg...
Music tracklist:
• The Complete Junferno ...

[@Junferno]

Corrections: [4:52] Timbre should be pronounced like "tamber" (tăm′bər) instead of "timber". [12:33] Due to contradictory references to the Daisy Bell recording in whether the synthesis was done on the IBM 7094, 704, or 7090, it is possible[author's conjecture] that the synthesis was demonstrated on multiple computers throughout its development. However, there is concrete evidence that it was at least demonstrated on the 7090, as stated by developers John Larry Kelly Jr. and Carol C. Lochbaum at a 1962 congress.[3]. [12:33] Although this segment is about the source-filter model, the model that synthesised Daisy Bell was actually either an "artificial vocal tract" (as described by Kelly and Lochbaum in 1962. Kenmochi Hideki called it an "acoustic tube model" in 2014[4]) or a "terminal analog" (Kelly and Lochbaum in 1962). Both comprised of a large database of parameters that applied ad-hoc rules given a sequence of phonemes, pitches, and timings, with the first model using articulatory parameters (e.g. nasal, labial) while the second used acoustic parameters.[3] While both it and the Voder were products of Bell Labs, the two had limited further relation. junferno.com/corrections/#list-1

[@jackpumpoen]

what is the plural of vertex?

[@asherasher9249]

Fourier is also pronounced /four ee ay/ instead of /four ee ur/ because french people

[@HEHEHEIAMASUPAHSTARSAGA]

vertices (VER-ti-sees)

[@28add11]

Edwin made you do this didn't he

[@EdenLippmann]

Just want to point out that timbre is a french word, so blame them.

[@EdenLippmann]

The most incredible thing about the Fourier transform is how it's simultaneously passionately celebrated and utterly despised by everyone who uses it. It's so powerful and versatile, yet so horrible to work with.

[@ungrave5231]

I remember when I first saw it just how much I despised the thing... yuck.

[@junkokonno]

this

[@btCharlie_]

Fourier transform is the OG love-hate relationship

[@prezentoappr1171]

@@btCharlie_ og teacher for me is 3blue1brown cant get wrong with mathematic tag of booru god bless rail programming lang

[@valshaped]

Fourier transforms and regular expressions

[@sangyoonsim]

24 minutes on how to become a Vocaloid? Can't miss.

[@LetrixAR]

Actually less

[@jas-3980]

Make an utau then make it have a vocaloid level voicebank

[@ruroruro]

24 minutes to get Bad Appl'd

[@aflvproductions7854]

My exact thoughts

[@Spaghetti742]

@@ruroruro 24 minutes to make a king cover

[@natalyacat]

the "听不懂“ floating across the screen on the chinese/bilibili bit of the video made me choke on my toast thank u. the way u incorporate humor into all the educational bits is fantastic and is why this is rapidly becoming my favorite youtube channel even though i know next to nothing about computer science. also jesus christ the ending had me losing it LMAOOOOOO

[@ur1c3hu33]

What does it mean?

[@pacopoko]

@@ur1c3hu33 "cant understand what your saying"

[@Catsrnice_]

@@pacopoko best part is that its said in chinese too 听不懂 (ting bu dong) instead of the traditional tingbudong meme for non chinese speakers

[@pacopoko]

@@Catsrnice_ i dont know if its a meme and i also cant quite comprehend what your saying

[@DanteEhome]

I found his Bilibili channel, and suprisingly he had very few views. I guess Chinese are too busy to understand his humor.

[@22pops]

not only is the music you used boosting my respect, but i feel like you're one of the only people who has talked about vocaloid + other singing synthesizers and gets literally nothing wrong. misinformation is a very prevalent thing in our community and it makes me feel happy that there isn't any in this! thank you for your work on this :D

[@fourplusoneissix2500]

Technical education is temporary, mikudayo is forever

[@calupoh9788]

2:33 there's so many great quotable moments in this video, but I lost it at "A pipe organ is similar to a piano, except for the fact that none of the parts are the same" for some reason great video man, hope you're having a good year so far!

[@aryanravi8164]

An unnatural natural pipe organ, also known as a pipe organ

[@finnclegg9526]

"the pipe is in the shape of a misshapen pipe"

[@fatitankeris6327]

The keysare _simmilar,_ at least.

[@andnekon]

"can't find any citation for sonic feet, I wonder why"

[@crownviking4408]

“artificial intelligence isn’t intelligence and the world isn’t a simulation”

[@amalgamidol]

as someone who's been involved in the vocaloid/utau community for a very very very long time this video fucks. there's a lot of misinfo and bad coverage of basically every modern singing synthesis program so it's dope seeing something made by someone who cares enough to parse the arcane mess that is UTAU. also ty for konnan janai at the end

[@fcantil]

I love how this guy starts explaining things from the very beginning of everything about sound and then also goes to explain the history of Vocaloid. Great work, Junferno! ...And of course, you can't have a Junferno video without Bad Apple.

[@gaemer3967]

Ending fucking killed me, I was seriously debating how technology is the point of life in my head only to get blasted by bad apple when I least expected it 😅

[@jody5661]

I was sitting there waiting to see if he was going to take it seriously or pull a stunt and then when it faded to Black I thought we were done it was so perfect

[@snowman4933]

you least expected that? That was my most anticipated part

[@ithinkpaulmightbehavinastr8878]

@@snowman4933 they seem to be new to the channel

[@snowman4933]

@@ithinkpaulmightbehavinastr8878 yeah, maybe

[@eggsdraws]

He's a genius.

[@adrien5568]

Junferno: "we get a sawtooth wave." Me: "Oh no no no." Junferno: proceeds to destroy my ears.

[@QweRinatrtY]

i guess you saw it coming, huh

[@ltva8781]

Wait why it sounds horrible for you Oh yeah you haven't listened to chiptunes for 2 years...

[@fishstick1900]

@@tanawatjukmongkol2178 Jokes on you I'm so used to my terrible sound design that even pure saw sounds pleasant to me. I wish that was a joke.

[@otesunki]

@@tanawatjukmongkol2178 pure saws sound perfectly fine to me aaaaaaAAAAAA

[@ehsome]

at 23:52 the subtitles say "[Epic funny " i really like the artistic choice of having only one bracket. also adds to the humor

[@Grayr]

Because at the end there "Bad Apple]"

[@PhilipHubbe]

17:28 Thanks for that explination.

[@ChessedGamon]

How to get into computer science: develop an obsession with anime women so crippling you turn to developing simulations to get as close as possible to one.

[@pinkhead6857890]

I thought it was desperately trying to script kitty your way out of solving a real math problem after failing calculus.

[@skepticmoderate5790]

@@pinkhead6857890 sympy

[@lydianlights]

@@pinkhead6857890 script kitty lol

[@whoisabishag3433]

Where Do I Sign Up

[@infiniteplanes5775]

Glad to see I’m not the only one. Chess algorithms are the closest thing humans have made to sentience by the way

[@johnr4724]

When there’s hatsune miku in the thumbnail But there’s also calculus

[@enderphoenix11]

Mood but have you also considered, 「Calc.」ft. Hatsune Miku ?

[@svetlana4133]

Makes me wanna get a vocaloid Software and write a song about calculus

[@ultimatedragon4281]

@@svetlana4133 Please do. And post it.

[@svetlana4133]

@@ultimatedragon4281 lmao alright

[@devd_rx]

I love both

[@Christer2222]

No matter how many Junferno videos I watch, the Bad Apple always catches me off guard even when I am thinking about it. I love the humor in these.

[@Penguin_Spy]

you perfectly balanced teaching about the history, math, music, and physics required to explain vocaloids without over- or under-explaining, and then ended it off with an existential crisis turned Bad Apple!!, brilliant. your sense of humor and timing makes for really entertaining and engaging videos that never disappoint, 👍

[@unowenwasholo]

Dude, wtf. The blank screen at 22:19 broke me. I was able to follow like a tenth of what was happening up to then, but my brain started freaking out when the visuals suddenly stopped. Putting that aside, along with almost everything about organs, incredibly informative and good crash course in the underlying fundamentals of what in the heck voice synthesizing software even does. I think. I only understood a tenth of it, but I feel smarter! Dunning-Kruger Effect, here I come!

[@marcuschiong306]

at 22:19 is he taking about NFTs

[@aquilazyy1125]

11:46 I really like how you can see him gradually becomes more aggressive when he says that.

[@xmus4023]

As a music producer of 5 years and counting, this is by far the most comprehensive understanding of music theory and production I have ever seen. Concise and understandable enough to fully flesh out the fundamental physical concepts underpinning the whole art form. It is insane.

[@psychicberry]

6:18 "complex sounds such as sentences" *crank that lyrics* 8:44 references skrillex rap battle.. which i could sub twice

[@Lea-fi3dd]

I can't believe you just explained pretty much the entirety of music. As always, great video!

[@goombizdvorakkiewicz5226]

Except for rhythm. Rhythm is when you play frequencies at a pretedetermined rate. It can be syncopated if you're into Math Rock.

[@prezentoappr1171]

@@goombizdvorakkiewicz5226 polyrhytm nightmare with a musician of my classmate; Common and ah sorry forgor the english terms "FPB dan KPK" god bless mr incredible meme with music meme and the demisemihemidemisemi---...quaver guy

[@DrSaav-my5ym]

really? the entirety of music? what does that even mean?

[@peachpink2831]

@@DrSaav-my5ym the entire video? What sound is, which combinations of sounds are pleasurable to the ears, chord progressions, how sounds are produced, organically and digitally, how different instrument makes different sounds and its contributions, the science of each notes itself, vocals, vocal synthesis, history of modern music production.

[@gommito]

8:15 You mean gameboy advanced, that's my favourite console! ohh...

[@amalgamidol]

just wanted to mention (since its brought up in the footnotes) that VCCV utau voicebanks use the same basic logic as CVVC voicebanks. they're named differently because, at least for english, they use different aliasing systems to represent each phoneme. for other languages, different names are used so individual methods can be told apart bc they all have to be used a little differently

[@antoinepins8322]

This is again a masterpiece, this is what humanity needed (I am looking at you e turning into kirby with the best version of bad apple ever created in the background)

[@dirtyduck6987]

After watching the whole video and considering the combined value of the consumed media, I came to the conclusion that this very video is not only quiet comidically plesureable to watch, frankly I dare to say it was even the most humorous work of art I came across all month, but also emensly intriguing, conserning the presentation and informational value of the subject at hand which leads me to say that this faboulously executed pictorial production is easily to be greatly recommended to everyone and valued as a sheer perfect use of your time, what makes it all the more frustrating to see, that seemingly only a handful of people are going to watch it and I really hope more people are going to find there way to this very recommendable youtube chanal. Applause

[@ongyuxuan6989]

This is literally a good summary of what music and audio is. What I've learnt throughout the years was summarized into just a single half hour video, which is just impressive. Junferno really did a great job right here, a bit unfortunate that most musicians or producers probably won't even notice this video

[@koharaisevo3666]

I has to say this channel only has 80000 subs is a crime.

[@noun6706]

Chanal💀 Awesome paragraph!

[@qwerty273]

That was the most readable, and pleasurable paragraph I've read... then you spelled channel wrong...

[@hahasamian8010]

With the sheer verbosity of this statement, I feel like the misspellings, which trigger my OCD, cannot be a mistake, and must have been intentionally placed to irritate people such as myself, who would read such a statement but find the misspellings uncanny.

[@415-k1ub]

Damn I didn't know that the UTAU software hasn't been updated since 2013. I recently looked up some UTAU stuff and found some new voicebank showcase videos, in 2022. For the Vocaloid scene, it's not as big as it used to be, but there's definitely some popular producers within it as well as new and rising producers.

[@shinoataya]

16:33 Defoko and Adachi rei: yes, real people

[@Faulheit]

the scripts on these videos are so well redacted it's insane lmao

[@nemoqwert1237]

just add some tribal drums and you got a ritual commin on in 19:20

[@arahenior2706]

11:41 is when I remembered this video is supposed to be about vocaloid

[@harukilol727]

The mention of what CV, VCV and CVVC was really nice, because I researched a little to know what it is, but gave up some time after Teto is nice And the Bad Apple caught me off-guard KSKSKEK

[@christophsiebert1213]

All the history of music and Vocaloid only to end up again in Bad Apple. Junferno truly is a constant in our lifes. Never change, my dude. You're awesome.

[@problemszzz2269]

Holy shit this might be my favorite video. Although i should've expected the ending you still caught me off guard

[@ydoomenaud]

At Anime Expo 2010, I attended a panel run by the Yamaha engineer then responsible for Vocaloid. He went into detail on how the software worked, pointing out the challenges of monastic chants in Latin, and as a graphic designer I couldn't avoid noticing the parallels between how proportional fonts use ligature tables/kerning pairs for aesthetic exceptions to standard letterspacing, and how Vocaloids concatenate specific phoneme pairs in its banks to sound more natural. I pointed out that Japan was already experimenting with physical-mechanical simulations of the vocal cords, tongue and lips for speech synthesis, so I asked why Vocaloid wasn't running physics-based simulations of speech instead. His response was that the average computer's resources weren't sufficient to crunch those kinds of numbers as efficiently or quickly as Vocaloid's "phoneme font" solution, and that it wasn't coincidental this speech synthesis system was created by speakers of a phonetic, Mora-timed language with exactly 45 phonemes, five vowel sounds and zero diphthongs, rather than by Western Europeans.

[@a52productions]

1:56 based septimal intervals Also!! I tried to implement a LPC source-filter myself, in python. I could never get the linear algebra to work quite right unfortunately, so it just made noise. But I might come back to it later some point.

[@heartlessalice5801]

wow really great video ^^ Also seeing all those papers, figures and researcher name really throw me back a few years when I did research on voice synthesis in school and read those exact same papers X) Thanks for the nostalgia I guess ^^ (and the math)

[@jokypoky]

I've learned more in this video than I have in my first 2 weeks of Technical Physics II. Thank you.

[@mard1_a]

15:23 Kaito IS the best vocaloid thank you for only speaking the truth !

[@mxxkyboi]

4:11 OH GOD I THOUGHT SOMEONE WAS CALLING ME IN THE MIDDLE OF THE NIGHT tho Native Faith is the perfect ringtone song you cannot tell me otherwise

[@newpaperyes]

The whole video I was waiting for a demonstration of your voice synth of yourself. Ending didn't disappoint.

[@lynx_1028]

I don't watch Junferno for the interesting content, I watch him to learn how to be hilarious while explaining boring stuff. I don't watch him to learn stuff i've learnt already, I watch him because he uses FTL soundtrack as a background for his videos. I don't watch him to inform myself in any way, I watch him just to see at which time is he going to reference bad apple. Amazing vid, hope to see another video in the next decade.

[@LC-hd5dc]

we get it, You Are Very Smart

[@lynx_1028]

@@LC-hd5dc i'm just here for the memes dude

[@ian5766]

“The pipes themselves were shaped like misshapen pipes” had me dead

[@DocJade]

I watched the entire video, and probably only retained 1% of the insane research he shared cant wait to watch this again and retain another 1%! amazing video as always

[@endlessboardgame985]

A full 1%? Impressive, given how much went over my head.

[@pccasio5628]

was 23 min into the video thinking where's the becoming a vocaloid part and i wasnt disappointed

[@Shinsemusic]

As a music producer, I love this video. You gave a really quick explanation of some fundamental concepts that are for some reason really hard for people wrap there head around, and also explaining how it relates to music theory. I know a lot of people how could really use the first 8 minutes of this video.

[@elgatto3133]

13:20 Ah elektronica, the casio of the soviet union (and belarus but who cares)

[@Samstercraft77]

"A pipe organ is similar to a piano except for the fact that none of the parts are the same"

[@avazimbokaluky1335]

This is amazing. I love the way you explain everything in a way that is understandable and also confusing in a way that makes the viewer want to research each topic after watching the video

[@luuexists]

I came into this video expecting it to be about you making an UTAU, only to be taught about the full history of voice synthesis. And then for the video to become exactly what I expected at the last second.

[@PHAS71]

Man, you remind me why math is fucking cool. Gotta study for that exam.

[@a_nebby_not_in_a_bag]

very nice to watch at 3am while repeating "one more video" and proceeding to not go to sleep

[@xX-DogSama-Xx]

was this just the worlds largest most interesting build up to a shitpost ever?

[@shivajoshi9068]

dude keep up the gr8 informational content! (that gives the feeling of learning so much...yet learning almost nothing)

[@Lyoishi]

That climax was amazing, like when you have to use all the game mechanics you learned at once at the climax of a game.

[@elideaver]

Just to be clear, old games consoles and computers didn't use Fourier shenanigans; they made sounds electrically, with RC circuits and shit

[@sebastianmestre8971]

what an awesome video dude. the timing of the GBA joke, the editing, the math, the the ending just *chefs kiss* perfect

[@Wapoose]

This video is so rewatchable. I watched it before I fell asleep yesterday, now here I am watching it as I wake up. I think this is the new life for me.

[@kageraavarrthun]

That bad apple at the end was so clean.

[@laundmo]

junferno: lets talk about vocaloid *proceeds to explain the entirety of music*

[@sykes1024]

15:45 "Utau is japanese for sing, but it's also japanese for english for japanese for that UTAU is a singing synthesizer" Lost my shit

[@sugakookie1628]

The quality of your videos are unreal!! Keep giving us stuff we didn't know we needed

[@RetoranPetrah]

why the hell are your videos so well researched dude, I'm doing voice frequency changing as a third year project in my degree and I've learnt way too much for a funny youtube video. I'd include this video in my citations if I hadn't already decided to approach the frequency change in the time domain.

[@charlotteowl467]

I knew what was coming and I must say the build-up was amazing and the execution was impeccable

[@matthew_blumenberg]

Bad Apple played on myself

[@jackpumpoen]

goddamit it’s bad apple again 23:26

[@maritoguionyo]

Yes

[@Nonzerotonin]

This is an incredible video, very well done! You make the big physics topics easy to understand, and the visual+audio examples you give help to reinforce the information. You've got yourself a new subscriber.

[@sehrsehrgut3379]

the pipe organ being similar to the piano except that none of the internal parts are the same was so funny to me and I don't know why.

[@BPNguinSoY]

0:56 had me 💀, idk why

[@iskamag]

I can't believe you BAProlled me like that... Good job.

[@thechaosofcaffeine]

11:48 this has the energy of someone who knows too much and is giving off a not-so-subtle warning

[@LeonKerensky]

10:55 And at that declaration: Joseph Fourier, Lord Kelvin, and the many mathematicians that dedicated their lives towards predicting tides rolled in their graves.

[@ZenoDovahkiin]

If youtube videos were like live performances, you would have been able to identify every single Tentacrul viewer in the audience as soon as he said "timber".

[@KookieDanish]

14:26 Miku with influenza -That's Miku NT-

[@Valery0p5]

Vocaloids have their charm, you know? Especially the ones before Ai

[@lutravurr]

this teaching style is optimized for my adhd i think

[@sinom]

2:48 Another normal search term ruined by a weird fandom...

[@OggerFN]

Finally another episode of never wanted to know this but thanks

[@okinawadreaming]

You know How people say "learning music theory will ruin pop music for you" This is exactly the video that did that for me.

[@TheTriforcekeeper]

22:18 That Faster than Light soundtrack caught me off guard! Great hearing that after such a long time :) Now onto the rest of the video!

[@moechano]

Miku will always advance as long as technology advances :) also nice cover.

[@sonnymoorexsonic]

junferno is hiding in my wifi ☹️

[@AexisRai]

1:53 "nice looking fractions" "wow it's my favorite song" (shows "7/5") better joke would be 7/8

[@yachatta5997]

almost like a Gameboy but more advanced... Like a Yamaha DX series synthesizer keyboard. That one cracked me up 😂

[@__8120]

6:14 what is that website? I remember seeing it in a VSauce video but I can't remember which one or what the website was called

[@Splattercat_art]

bilibili??

[@Incognito-rb4tz]

6:09 听不懂ww

[@CommentBanana]

you have not only earned my subscription but my life long adoration

[@Garfield33333]

This video is so well done. All of the jokes are perfectly timed and absolutely hit, while blending effortlessly with the rest of the content, thank you for all the work you put into this!

[@iwaslazkis]

Anybody know what the software is that Junferno uses at 6:15 to 6:19?

[@madladdie7069]

Why do I feel like you only made this because you didn't want to waste all the research you had to do to get your vocaloid version of Bad Apple!! to work? Also, are you planning on releasing a full vocaloid version of that?

[@tibethatguy]

I think you meant UTAU instead of Vocaloid, as the licence you need to make Vocaloid VBs aren't really available for the public and also ridiculously expensive, not to mention the quality standards?

[@LC-hd5dc]

tfw "not@@tibethatguy " but you are that guy

[@madladdie7069]

@@tibethatguy ah. my bad.

[@madladdie7069]

@@LC-hd5dc s'fine in this case. i wasn't getting it wrong on purpose for the meme's sake.

[@gattomiaomiao9634]

This was easily the best video I've seen since beginning of the year. Thank you so much for your work, it is both fascinating, addictive and interesting. Greetings from Italy

[@PanzerSparrow]

The quality of this is top tier! Fantastically entertaining video and surprisingly instructive. I also laughed my ass of like all throughout the video, and that Bad Apple was fire XD.

[@m1lkweed]

>"the timber" Aha, clearly Jun is a fool who knows nothing of music /s

[@mayatung]

They should do more research on sonic feet to figure it out

[@vcool122]

Junferno: "Like a gameboy, but more advanced" Me: "So the gameboy advance?" Junferno: "Like the Yamaha DX series syntesizer keyboard." Me: "... I see what you did there."

[@uchirrod]

I am 4 months late, but this is definitely one of the best videos i've ever seen.

[@mrED123]

I’m telling you Junferno explains an idea and many concepts related so well. I’m really happy I found your channel! Best wishes

[@nivin5166]

i love you and your content so much,, theres so much technical things but its so funnily put together i could watch for hoursss

[@porkur]

Your videos are always the perfect blend of confusion and humour, also the amount of research and effort you put in I really appreciate. amazing cover!

[@thyscott6603]

I love the quality of the videos and thumbnails. Brings me back to 2012

[@zoklev]

gosh I love your content and I'm so glad YT recommended it to me just earlier