Black MIDI, but every note spawns a physics object... (4k, 60fps, ray traced)

I created a program in Unity that can read Black MIDI files and generate a Synthesia like visualization. However, each time a piano key is pressed, a corresponding tetromino physics object is spawned (since it plays the Tetris Theme A). The high note density areas created some interesting effects.
I had a simpler version of this almost done, but for some reason I always feel the need to do a bunch of extra modifications that people probably won't even notice (60fps + 4k, I still don't have a 4k monitor, so I don't even know what it truly looks like, lol). After figuring out how to use Unity's HDRP, I couldn't resist setting up path tracing. Unfortunately, the Unity Recorder package isn't capable of waiting for the ray tracing paths to converge before moving to the next frame yet. To circumvent this, my code paused the simulation for about 200 frames for path convergence stalling, took a 4k screenshot, then repeated the process for about 72 hours straight. I was very sad when a bug in my code glitched out the physics at the very end of the simulation. Surprisingly, after fixing it and skipping a bunch of frames to set up a pick up shot where it failed, the physics behaved deterministically so the transition was unnoticeable.
Massive thanks to Kanade Tachibana for allowing me to use this MIDI file!
Link to original video: • Tetris Theme V4
Link to Kanade Tachibana's channel: / @kanadetachibanablackmidi
Music: Tetris Theme A
Cash Register Sound Effect:
freesound.org/...
It was super fun making the patron thank you outro screen. The blocks are ordered and sized in terms of lifetime contribution, as well as color coded by tier. I'm not making any money off this video. If you would like to support me and appear on screen in the next patron shoutout, here is the link to my Patreon page: / doodlechaos
/ doodlechaos
/ doodlechaos
[e-mail]

[@5MadMovieMakers]

Mom says to clean up your 3.5 million blocks when you're done

[@stresswaves01]

Here to steal a portion of likes

[@prithviproduction4412]

Here to steal a portion of portion of likes

[@43615]

it's only 90000, or i guess 360000 if you count the components of the tetrominos

[@aaaaaaaaaaaaaaaaaaaaaaaaah]

I'm sorry I have to make it 201 likes

[@halloweenlover1031]

Here to steal a portion of portion of portion of portion of likes

[@zacherychapman8474]

Black Key: "Mom, I'm scared of those shadows" White Key: "The shadows can't hurt you." The shadows: 0:23

[@pikchassis]

good one

[@RoverHouse]

Correction the shadow is seen all the way through for extra explosives

[@RoverHouse]

Man I want to throw reactors in creative mode already

[@bghmusic]

Never have my eyes seen something more beautiful

[@getoguy5979]

When i watched this i thought of your impossible remixes i watched.

[@DoodleChaos]

I sense a collab opportunity

[@bghmusic]

@@DoodleChaos sure let's go

[@DoodleChaos]

I sent you an email 👍

[@indigoblunter]

DUDE IT'S HAPPENING

[@sebastianverhagen1810]

I love how the melody is still recognizable, even with all the runs and full-piano slams happening

[@et0t]

Note Velocity

[@antrix2107]

Blackers use velocity to adjust every parts of the piano

[@Expunged-fnf]

They make the slams queiter so tits reconizable

[@ChristopherMoom]

The real reason you never get to see the product of all the Tetrominoes is because DoodleChaos is insanely lucky and the Tetrominoes all happened to line up perfectly when they fell down off screen, causing them to disappear like in actual Tetris Jokes aside this is a really neat video, it's really satisfying whenever the song makes an explosion of Tetrominoes, great stuff

[@Bingtube69420]

Hi

[@taemoowoo7628]

Dang

[@halloweenlover1031]

1:59 how are these sounds satisfying

[@nanamacapagal8342]

They're not lucky. They're a mastermind and they planned all the pieces to land exactly where they should.

[@BlankWav3]

Why the hell do I see you everywhere?

[@DoggoGod]

I love how you can see the shadows move and you have a couple seconds to prepare yourself

[@alanaspacio2352]

maybe I will subscribe him

[@RubyBlooming]

Shout outs to the one green block that gets on top of the piano at 1:15, they went where no block had gone before

[@schmeag7710]

Wow that’s funny I didn’t notice that

[@talonstride]

I saw.

[@ElectronicOkapiMusic]

How did I not notice that before? LOL

[@mrmurpleqwerty4838]

I am on top of the pianoOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOO

[@jellyman1864]

It happened because there was 2 notes so that note clipped through

[@KrazyKF]

"Oh hey, this isn't that bad so far." 0:24 *The shadow.*

[@dayzm6708]

Same thought hahah

[@EclipsaEldrich]

Same

[@cookie3549]

Yes

[@tim9680]

Foreshadowing

[@howevervideosolderthan4stay]

Not funny

[@znox_x6165]

The parts where the music sounds like it explodes is so satisfying lol

[@nazrarain1452]

That was my favorite part. It's a really cool addition

[@halloweenlover1031]

i am stupid

[@nazrarain1452]

@@halloweenlover1031 It's like a sound of pressure release, like built up stress finally released and allowing you to feel calm. I love it

[@noskillman6507]

@@halloweenlover1031 explosions are always satisfying

[@oogaooga0000]

1:59

[@sergiorodriguez06]

2:29 at this point with that amount of notes spawning the piano looks really smooth

[@abstractn027]

"Did you do it?" "Yes" "And how much RAM did it cost?" "...Everything"

[@timmyg8888]

All of it*

[@talonstride]

😱 RIP low-end PCs.

[@insert_username_here]

@@timmyg8888 *everything.

[@emilyingram3501]

*yes

[@wackgaming6639]

I understand the reference

[@gingeas]

this is epic! :D

[@susgaming8935]

yes

[@piguy8876]

how does a gingeas comment have only 3 likes???

[@burichingschannel1968]

Verified guy woth 16 likes lol

[@achoi2669]

"yeah im apart of percussion" "oh yeah? what instrument do you play?" "piano."

[@oxfordcommaisthegreatest]

I mean, technically you're right, piano is in fact a percussive instrument

[@CreativeStarlet]

Indeed. It is actually percussion.

[@Avriel_Mimiga]

@@CreativeStarlet ye cuz the hammers

[@CreativeStarlet]

@ALEX LUONG Well, not exactly. It's quite complicated and that's the debate. However, I believe it is officially classified as a percussion instrument. It's not classified as strings, but there is a whole debate on why it should that I have no opinion on. Basically, in simple terms, inside a piano are a bunch of strings and then there is hammer like objects lined up at each of those strings. When you press a key, the hammer like thing will hit the string. This is why there is so much controversy about what it classify's as. I hope this helped. Thanks from reading this, and remember to stay positive. Good day!

[@achoi2669]

@@CreativeStarlet banger comment you have a good day too

[@arsonistnpc]

i got a discord notif as soon as the song ended. absolutely magnificent

[@meILM]

I want to see all the pieces at the bottom fit together perfectly

[@DarkSalamander0]

Flashbacks to slime tetris

[@ShOwOba]

Well, the thing is, that's impossible, since of they fitted together perfectly they'd just disappear xD

[@meILM]

@@ShOwOba lol true

[@Morningstar_37]

@@ShOwOba Maybe they did, and that's why they never reached the bottom of the screen

[@omegahacker5798]

you too?

[@hiimpurple8729]

Omg when that green line pops, it’s so satisfying

[@qwertyb1883]

I can't imagine all the effort that went into this video, all the time it took ti write the midi, coding the 3d objects, render time, and especially all the thought and effort that went into the thumbnail. Good job, Doodle!

[@DoodleChaos]

MIDI was created by Kanade Tachibana! Link to their channel in description. Thanks QWERTY!

[@fxbeats222]

@@DoodleChaos epic

[@dizzy_jump]

@@DoodleChaos reply to this

[@sandboxiconiii4726]

This guy keeps making videos I never ever have thought about. every single video just makes me really impressed.

[@evanz9752]

Every computers nightmares be like:

[@hutao1341]

Lol

[@quanghg08]

Lmao

[@ultradriplorddk7800]

Computer: NO PLEASE! I CAN'T RUN THAT D:

[@sillicon8227]

@Alexander Vang This IS rush e

[@lancetheking7524]

1k liker nice, and Rush E turns the computer into the surface of the sun

[@forgettablePyromaniac]

Ah, yes. Let's raytrace our Midis. We're finally reaching the graphics Toby reccomended for his own music

[@timemachine-ml4wx]

yes yes yes yes yes yes yes yes yes yes yes yes

[@delicioushomemadestrawberr8730]

I would've liked to see the product of the blocks below

[@firewren]

They are probably despawned when they reach the floor to save on processing power to avoid the simulation from slowing down from limited process power or crashing from running out of RAM

[@delicioushomemadestrawberr8730]

@@firewren yeh I know but it'd still be cool

[@redstonerti9918]

@@firewren 2TB of DDR5 samsung 512GB sticks @7200MHz should do the trick lol

[@dialga4688]

A gigabyte of ram should do the trick

[@HehehehawYt]

@@dialga4688 it can't even run minecraft and he's doing it on 4k, 60 FPS, RAY TRACING. it will take 1tb/1000 gb

[@Qoride]

1:12 props to that one green block that made it on top of the piano

[@randallstevenson2528]

I see you have truly embraced the Chaos part of your channel name. Great job on another video!

[@scratchcoder9999]

I see you have truly embraced the Chaos part of your channel name. Great job on another video!

[@scratchcoder9999]

I see you have truly embraced the Chaos part of your channel name. Great job on another video!

[@scratchcoder9999]

I see you have truly embraced the Chaos part of your channel name. Great job on another video!

[@scratchcoder9999]

I see you have truly embraced the Chaos part of your channel name. Great job on another video!

[@scratchcoder9999]

I see you have truly embraced the Chaos part of your channel name. Great job on another video!

[@razerbladegaming8515]

I loved it whenever he hit that tree of green notes. The spray of Tetriminos at the bottom made me laugh every time

[@pikisachu]

And the sound is just-mmmmmmm 🤌

[@nickel-alloys]

To those who don’t know, this song has a name rather than “Tetris Theme”. It’s “Коробейники (Korobelniki)”.

[@randominternetperson8464]

Adding a reply.

[@HueHanaejistla]

@@randominternetperson8464 Replying to a reply.

[@randominternetperson8464]

@@HueHanaejistla replying to another reply!

[@randominternetperson8464]

@Queena Yang replying to another reply of another reply of another reply.

[@sangchoo1201]

replying.

[@qwq9348]

You could help create the next best selling game...with Ray tracing and everything...but you chose this...Good on you man.

[@tumbleweed8293]

Sheet music boss is evolving. We must stop their power

[@VienzAndRosabellLOLZ]

This is DoodleChaos’s channel though- Am I missing a joke here? I think I am ;-;

[@tumbleweed8293]

@@VienzAndRosabellLOLZ basically she’s music boss does some impossible tutorials that no human could possibly do and it’s spreading like crazy to other channels. It is in fact a joke that was unclear.

[@VienzAndRosabellLOLZ]

@@tumbleweed8293 ohhh, now I understand :D

[@Emperordgualica]

@@tumbleweed8293 it probably started with the RUSH series.

[@afxm-1190]

Bruh this midi is older than sheet music boss iirc... smh also this is kanade tachibana not SMB

[@Joshua93853]

Never have I heard a piano note played so fast it doesn't even sound like a piano.

[@n1thecaptain965]

The poor player trying to line all these up: *_confused screaming_*

[@arburo]

How many notes you want? DoodleChaos: Yes Also. Love this Tetris theme rendition.

[@TT-gm5yv]

This is more like "PC spec show-off" but with a musical twist. I love it.

[@calccalccalc]

As a Unity developer myself, you are an inspiration.

[@sufiemohd3128]

His computer be likes :" why you do this to me I thought we are friends"

[@devalinohizkiapradipta2157]

Yes, we frenemies

[@godzillaridergamer]

“oh nono, we are friends, but… t e t r i s p i a n o”

[@Epic_R3K47]

XD

[@mikathegaything]

his computer is a beast and what are we doing to beasts: killing em

[@lepoliceno3731]

I laugh in complete joy knowing that this channel exists

[@ilikecorndogs]

i demand all black midis to be visualized like this from now on. just too satisfying to go back

[@Goual]

This channel deserved its name on this one

[@dren6639]

I love how the piano is playing the theme, then a key decides to bang on the entire piano

[@rawrwata5289]

This totally belongs on one of those strangely satisfying compilations or whatever they're called I love this

[@tparadox88]

When you read the description and find out the computer was arguably rendering 12,000 FPS for the path tracing.

[@hakhpu693]

2:10 this part is my favorite part, epic

[@wawariors]

Hey, just wanted to say that I love your vids and all the work you put in them. Please continue your videos!

[@Goonin666]

My eyes and ears have never experienced so much satisfaction at the same time until now.

[@delicioushomemadestrawberr8730]

Tetris level 20 be like:

[@Koweret]

30 in NES version*

[@coleafton6045]

Relatable

[@FireyDeath4]

Even in the most dense of black midi videos (like, the ones that pretty much make compound sounds), I don't remember hearing any digital piano being played so aggressively. Don't you hate when it's hard to appreciate things that are so detailed?

[@greenjc12]

Beginning of the video: "oh nice, tetris theme with some tetrominoes falling out the bottom, cool" End of the video: *HAHAHAHH MEGA DEATH MODE ROBOT NOISES GO BRRRR AND MANY MANY BLOCKS GO SQURRSHIHSHSHHSSSSHHHHH*

[@RandomCommenter4890]

THIS MAN IS SO INTELLIGENT CLEAN 3.5M BLOCKS

[@clevelandHater]

I knew it was about to get real when I saw the shadows of the first massive cluster of notes slowly descending

[@alejandrite9]

i was kinda hoping to see the pile of tetrominoes after the midi was done great stuff though lol

[@FUNKYZUNK]

1:59 could be my favorite part

[@gamercc0463]

When a fly passes by your ear

[@wishbone4038]

These videos combine my 3 favorite things, physic simulations, classical music, and satisfying shredding videos🤣

[@scarylion1roar]

I am the man who arranges the blocks that descend upon me from up above. They come down and I spin them around 'til they fit in the ground like hand in glove. Pig With the Face of a Boy

[@Thetitaniumsteppermotor]

Just watching this made my computers fans turn into a F1 car

[@EXT4NT]

So that's where the Tetris pieces fall from

[@DoodleChaos]

This is how they are born

[@TheAdvertisement]

Tetris pros are getting so insane they became masters of both types of keyboards.

[@benjaminprietop]

Sheet Music Boss: finally, a worthy opponent, our battle will be legendary

[@omegahacker5798]

you watch him too?

[@mikeshirona1319]

I think half the people on this channel watch him.

[@TheLostWarriorYT]

The program is impressive but I think I'm more impressed that his PC can handle this and not lag at all

[@ghastiafy67]

alternative title: Black MIDI HACKER VERSION every note spawns a Tetris block

[@DoodleChaos]

Hacker version lol

[@DerInhaberDerKrossenKrabbe]

@@DoodleChaos sus

[@thecomplimentguy3501]

What a bunch of craziness and insanity! And this is exactly what I have imagined.

[@bubbles8871]

Each time it played every note at once, it felt like I was being hit directly in the chest with an RPG.

[@channel-nb7vx]

Me and the orange notes are very similar. Whatever we do, it always ends up with a “L”

[@redzap13]

Me: Piano is not chaotic. *after watching this Me: uh... um... Beep Boop Red Zap lost control. Bye!

[@omegahacker5798]

hehehe yeah no theres worse things

[@HueHanaejistla]

@@omegahacker5798 ????

[@omegahacker5798]

@@HueHanaejistla battle against a true hero imposible

[@HueHanaejistla]

@@omegahacker5798 not as chaotic as this and it's not that hard. its not a super fast song

[@omegahacker5798]

@@HueHanaejistla megalovania then

[@8bitbunnie936]

this is my favorite video of yours by far

[@-FutureTaken-]

(This joke has probably been done) Teacher: The test isn’t that confusing The test:

[@lacrak27]

I have just realized that black midi is like a TAS for pianists

[@DarkSalamander0]

At a certain part it just feels like the keyboard is moving up

[@MrProPics]

What a beautiful creation you have made

[@pandacuh.]

Imagine playing Tetris with the same physics objects and you beat the level… 🤯🤯🤯

[@Kids_Scissors]

the shadow of the upcoming waterfall of notes invokes a feeling of dread lmao

[@schmeag7710]

The second after the explosion thing at 1:47 sound so cool and idk y

[@mayexkither6656]

i can hear your GPU screaming for air THROUGH my monitor

[@ตูนเดชาดีวาจิน]

1:22 🤣🤣🤣🤣🤣

[@ตูนเดชาดีวาจิน]

1:15 green block on the piano

[@jellyman1864]

Emojis puking be like

[@TheoJanvinRBLXandGI]

Whats so funny thai

[@anniewaysofficial4497]

This channel is like my adhd but in visual form

[@rendipranata5572]

Unfortunately his PC didn't explode...

[@Fionacle]

My favorite part of midi covers is how unnecessarily chaotic they get by the end, I don’t understand how your computer handled all that chaos

[@KesfiFadly17]

Damn i'm watching this at 360p, but when you enter the last part the resolution just drop to 144p

[@DoodleChaos]

Do 4K 60fps! I set up ray tracing as well

[@kingkylotcxxx1992]

My Internet barely does 720p60 but just for this video I'll go 1444p60 Edit: I did try and go 2160p60 but the video when loaded was laggy

[@phakphumchiwasrirungrueng1272]

It looks like a Tetris game that’s awesome dude !

[@ArsonApple]

Now the real question is: Which color has the most objects?

[@user-zq6rb2nx7k]

I think it's red

[@ReirtoRRNTX]

Maybe red or green

[@user-zq6rb2nx7k]

@@ReirtoRRNTX I guess

[@user-zq6rb2nx7k]

Btw my comment is a little sus

[@ReirtoRRNTX]

@@user-zq6rb2nx7k e

[@dayzm6708]

This is epic man!

[@chandrakanthanisetty6123]

The physics object is sand,"color sand"

[@Quinnie0821]

I don't know how, but even though I have never seen this video before, I automatically hummed the tetris theme as I clicked on the vid.

[@Fpvelox]

When I cut my grass 1:08

[@ollie3618]

What????

[@义丹丂爪刀工三尺]

I would not have thought that something like that is possible. just extraordinary

[@abhinav3478]

"How much time will it take to render?" PC: yes

[@erridkforname]

I love how the nothes explode everywhere when theres so many happening at once

[@levimorton483]

Perfect for what Ethan calls the Tetris King!

[@karenmclennan7976]

Bruh Tetris just took every single kind of drug possible and has became its own god of chaos

[@mpreg444]

seeing the shadows of the oncoming notes makes this much more terrifying for your pc oh my god

[@straybricks]

A musical representation of how children add sprinkles to Christmas cookies.

[@novygaming5713]

If you made it realtime your computer won't explode instead it will literally be THE MOMENT OF HUMAN ENHIALATION ..... actually now that i think about it its actually a good thing you baked it

[@Pv3Coca]

everybody is having a normal life until a stranger plays this at a mall

[@lightningboltpianist5536]

Request Black-Midi, but Every Note Spawns, Piano keys:

[@Kaii-Rodgers]

accurate depiction of block distribution in tetris, few lines, and so many z's

[@orngjce223]

I like how the blocks are the right colors to match too

[@abarette_]

10 days ago: *struggling to render Synthesia script Present day: "kek if I do that will my computer crash"

[@lueroso1540]

This reminds me of the earlier days with people watching the Black MIDI videos of Night of Nights from Touhou, seeing all the notes, and joking about needing multiple fingers, even breaking your fingers just to play it. This is a nostalgia trip.

[@orangehax5280]

This looks amazing!

[@Bukašius]

"Congratulations, you SURVIVED!"

[@stormace695]

This is just simply beautiful

[@Rose-ff3fi]

Alt title : How to torture your computer Btw this video is awesome

[@deathrobot10k58]

I like how in the start you could see the incoming chaos from the shadows